Data Engineering Manager
Core
Design and maintain data platform roadmaps and structures to support business and technology objectives, delivering consumable data and AI solutions.
Role type
Senior IC data engineering manager (solution architecture)
Builds
Scalable, fault-tolerant data and AI solutions, data mesh architectures, and integrated ML pipelines
Domain
Data engineering, AI/ML, cloud infrastructure
Deliverable
production ML models
Required skills
Solution architecture design, CI/CD and DevOps, Data Mesh design, AI/ML integration, Cloud ecosystem mastery (AWS/Azure), Modern data stack (Databricks/Snowflake), Data pipeline development, Technical leadership and mentorship
Preferred skills
Platform certifications (Databricks), Kafka/Spark/Flink, Containerization (Docker/Kubernetes), Feature pipelines, Training/serving parity, Vector DB integrations
Technologies
AWS, Azure, Databricks, Snowflake, Python, SQL, Java, Kafka, Spark, Flink, Docker, Kubernetes, MLflow
Responsibilities
Design end-to-end complex data and AI solutions; Conduct solution assessments of existing systems; Champion data mesh architectural approach; Define pipelines for AI/ML model integration; Design and optimize cloud solutions; Drive adoption of modern data platforms; Oversee implementation of automated data pipelines; Provide technical leadership and mentorship; Collaborate with stakeholders to gather requirements and present options; Evaluate new technologies and methodologies; Ensure security and compliance in architectural designs
Seniority
Senior, hands-on IC with management responsibilities
