Lead Data Engineer
Core
Lead Data Engineer setting technical approach for migrating legacy data warehouse data and pipelines onto an Azure and Databricks lakehouse.
Role type
Lead Data Engineer (Cloud Migration)
Builds
Reusable migration pipelines and lakehouse infrastructure
Domain
Cloud Data Engineering / Federal IT
Deliverable
production ML models | infrastructure
Required skills
Azure Data Factory, Azure Databricks, Spark, SQL, Python, Lakehouse architecture, Delta, ETL modernization
Preferred skills
Federal or regulated data environments experience, mentoring
Technologies
Azure Data Factory, Azure Databricks, Spark, Delta, SQL, Python
Responsibilities
Set technical approach for data migration, guide migration teams on patterns and quality gates, design reusable pipelines, reconcile source and target data, resolve pipeline performance problems, mentor data engineers
Seniority
Lead, hands-on IC with mentorship