Lead Data Engineer
Core
Lead a team of data engineers to design, build, and migrate large-scale data platforms and pipelines.
Role type
Senior IC lead data engineer (cloud data architecture & migration)
Builds
Scalable data platforms, ETL/ELT pipelines, and data models
Domain
Financial services / Insurance
Deliverable
production ML models
Required skills
Azure Databricks, Snowflake, DBT, Python, SQL, Terraform, Data Architecture, ETL/ELT, Data Migration, CI/CD, Data Modeling, Team Leadership
Preferred skills
Data governance, Observability, Kafka, Event Hubs, Delta Live Tables, Lakehouse architectures, Multi-cloud environments
Technologies
Azure Databricks, Snowflake, DBT, Python, SQL, Terraform, Kafka, Event Hubs, Delta Live Tables
Responsibilities
Lead and mentor a team of data engineers, setting technical direction and driving engineering excellence. Own end-to-end architecture, design, and implementation of scalable data platforms and pipelines. Define and lead data migration strategies from Snowflake/SSIS to Azure Databricks and DBT. Drive Infrastructure as Code with Terraform and CI/CD adoption.
Seniority
Senior, hands-on IC with leadership responsibilities