Lead Data Engineer
Core
Designing and modernizing enterprise data engineering architecture, migrating legacy on-premises systems to cloud-native AWS patterns, and ensuring platform health and data quality.
Role type
Senior Lead Data Engineer (Enterprise ETL/ELT & Cloud Migration)
Builds
Enterprise data platforms, cloud-native data pipelines, and modernized ETL/ELT architectures.
Domain
Enterprise Data Engineering, Legacy Modernization, Cloud Migration (AWS)
Deliverable
production ML models | infrastructure
Required skills
Enterprise ETL/ELT architecture, Large-scale data platform operations, SQL (IBM DB2, SQL Server), IBM DataStage, Cloud migration strategy, Automation, Data quality monitoring, Release management, Stakeholder management, Knowledge management
Preferred skills
Apache Airflow, dbt, AWS Glue, Spark, ServiceNow, Capacity planning, Disaster recovery compliance
Technologies
AWS, IBM DB2, SQL Server, IBM DataStage, IBM Workload Scheduler, Oracle GoldenGate, Apache Airflow, dbt, AWS Glue, Spark, ServiceNow
Responsibilities
Define enterprise data engineering architecture and technology standards; Lead multi-year platform modernization roadmap from on-premises to AWS; Govern platform health including capacity planning and disaster recovery; Lead workload rationalization and pipeline consolidation; Drive adoption of modern data engineering capabilities; Own SLA adherence and lead root cause analysis for critical incidents; Lead monthly release cycles and change control governance; Maintain backlog visibility and executive reporting; Define data quality monitoring frameworks; Serve as primary relationship owner for senior stakeholders; Deliver operational and executive reporting on pipeline health; Develop multi-year data engineering roadmap; Lead phased AWS cloud migration strategy; Identify and implement automation opportunities; Lead knowledge management across the engineering team.
Seniority
Senior, hands-on IC with leadership responsibilities
