Manager Data Engineering
Core
Lead the design and delivery of scalable, cloud-native data engineering solutions and modern data platforms for clients.
Role type
Manager, Data Engineering
Builds
Enterprise-scale data platforms, batch and real-time data pipelines, and cloud transformation programs.
Domain
Enterprise Data Engineering / Cloud Computing
Deliverable
production ML models
Required skills
Cloud platform architecture (Azure/AWS/GCP), Python, Distributed data processing (Spark/Flink), Data ingestion/streaming (Kafka/NiFi), ETL/ELT pipeline design, Data governance, Team leadership, Technical architecture reviews
Preferred skills
Data governance platforms (Collibra/Alation), CI/CD, Infrastructure as Code, Containerization (Docker/Kubernetes), Generative AI data platforms
Technologies
Azure, AWS, GCP, Python, Scala, Spark, Flink, Kafka, NiFi, Airflow, MongoDB, Cassandra, BigQuery, Redshift, Presto
Responsibilities
Lead design and delivery of large-scale data engineering solutions; Architect batch and real-time data pipelines; Provide technical leadership and mentorship to engineering teams; Collaborate with stakeholders to translate business requirements into technical solutions; Drive cloud transformation programs; Establish best practices in data engineering and security
Seniority
Manager, hands-on technical leadership