Senior Data Engineer with Databricks
Core
Designing, implementing, and standardizing scalable data pipelines on Databricks for clients in the financial and market data sectors.
Role type
Senior Data Engineer (Databricks)
Builds
Production-grade data pipelines and transformation layers
Domain
Data Engineering / Financial Services
Deliverable
production ML models
Required skills
Databricks, Python, dbt, Data Pipeline Design, Data Orchestration, Cloud Platforms (Azure/AWS/GCP), Data Modeling (Medallion/Dimensional), Legacy System Migration
Preferred skills
MLOps, ML Lifecycle Support, Global Distributed Team Experience, Large-scale Multi-region Data Onboarding
Technologies
Databricks, dbt, Python, Azure, AWS, GCP, Snowflake
Responsibilities
Designing and implementing scalable data pipelines on Databricks; Standardizing existing pipelines using a gold standard approach; Migrating and refactoring legacy data pipelines; Developing data transformations using dbt and Python; Supporting onboarding of new datasets from US and APAC regions; Collaborating with data architects and analytics teams; Contributing to future Data Science and MLOps foundations; Optimizing performance and resource usage under capacity constraints.