Associate, Data Platform Engineering
Core
Build and operate enterprise-scale Azure and Databricks data platforms, ensuring scalability, reliability, and security for investment decision-making.
Role type
Associate Data Platform Engineer (Azure/Databricks)
Builds
Scalable data pipelines, ETL/ELT processes, and cloud-based data solutions on Azure Databricks.
Domain
Financial Services / Data Engineering
Deliverable
production ML models
Required skills
Azure Databricks, Apache Spark, Delta Lake, Python, SQL, Azure Data Factory, Terraform, CI/CD, Kafka, Azure Event Hubs, Databricks Workflows, Unity Catalog, Delta Live Tables
Preferred skills
Financial Services experience, real-time event-driven architectures
Technologies
Azure, Databricks, Apache Spark, Delta Lake, Python, SQL, Azure Data Factory, Terraform, GitHub Actions, Azure DevOps, Kafka, Azure Event Hubs, Azure Monitor, Log Analytics
Responsibilities
Develop and maintain scalable data pipelines and ETL/ELT processes; Support data ingestion from internal and external sources; Optimize cloud-based data solutions and enterprise platforms; Monitor data quality, performance, and reliability; Contribute to data governance, lineage, and documentation; Participate in code reviews and engineering best practices.
Seniority
Mid-level, hands-on IC