Associate, eSupport/Development Engineer
Core
Develop and modernize a critical data platform for regulatory and compliance surveillance, migrating from Azure-SQL to Azure Databricks.
Role type
Associate Data Engineer
Builds
Scalable data ingestion, transformation, reconciliation, and data-quality processes for regulatory surveillance
Domain
Financial services / Regulatory compliance / Data engineering
Deliverable
production ML models
Required skills
Advanced SQL, Python, PySpark, Azure Databricks, Azure Data Factory, ETL/ELT, Data modeling, Performance optimization
Preferred skills
Experience in financial services, Regulatory/compliance/risk/surveillance environments
Technologies
Azure-SQL, Azure Databricks, Python, PySpark, Azure Data Factory
Responsibilities
Migrate existing data processing from Azure-SQL to Azure Databricks, Develop and support scalable data ingestion and transformation pipelines, Optimize Python-based analytics models and Spark workloads, Troubleshoot production and performance issues, Ensure data accuracy, timeliness, scalability, and traceability
Seniority
Associate, hands-on IC