Lead Data Engineer
Core
Lead technical strategy and execution of large-scale data modernization initiatives, migrating legacy data warehouses and pipelines to a modern Azure and Databricks lakehouse architecture within a federal technology environment.
Role type
Senior Lead Data Engineer (Cloud Modernization)
Builds
Scalable cloud-based data lakehouse architectures and migration frameworks for public-sector services
Domain
Federal/Government technology, Cloud Data Engineering
Deliverable
production ML models | infrastructure
Required skills
Azure Data Factory, Databricks, Apache Spark, SQL, Python, Lakehouse architecture, Delta Lake, Data migration, Pipeline design, Technical leadership
Preferred skills
Federal/government data environment experience, Government compliance knowledge
Technologies
Azure, Databricks, Apache Spark, Azure Data Factory, Delta Lake
Responsibilities
Define technical approach for migrating legacy data warehouse environments to Azure/Databricks; Establish standardized migration frameworks and best practices; Design and develop reusable data migration pipelines; Define data reconciliation strategies and validation processes; Establish data quality controls and testing standards; Provide technical leadership in resolving complex pipeline challenges; Mentor data engineers and review engineering deliverables; Collaborate with Product, QA, and Platform teams; Communicate technical decisions and risks to stakeholders.
Seniority
Senior, hands-on IC with leadership responsibilities
