Lead Data Engineer
Core
Lead and architect scalable data platforms, driving cloud-to-cloud migrations and implementing robust ETL/ELT pipelines for the insurance or financial services industry.
Role type
Senior IC Lead Data Engineer (Data Platform & Migration)
Builds
Scalable data platforms, data pipelines, and migration solutions for insurance/financial clients
Domain
Insurance / Financial Services / Cloud Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Data Engineering, Azure Databricks, Snowflake, dbt, Python, SQL, Terraform, Data Architecture, ETL/ELT, CI/CD, Data Migration, Team Leadership, System Design
Preferred skills
Data Governance, Observability, Kafka, Event Hubs, Delta Live Tables, Lakehouse Architecture, Multi-cloud Operations
Technologies
Azure Databricks, Snowflake, dbt, Terraform, Kafka, Event Hubs, Delta Live Tables
Responsibilities
Lead and mentor a team of Data Engineers, providing technical direction and conducting code reviews; Own the end-to-end architecture and design of scalable, reliable data platforms; Lead implementation delivery from design through deployment; Define and drive data migration strategies from Snowflake and SSIS to Azure Databricks and dbt; Design and oversee scalable data pipelines and data models; Lead the implementation of Infrastructure as Code using Terraform; Act as the primary technical owner for complex troubleshooting and long-term platform stability.
Seniority
Senior, hands-on IC with leadership responsibilities