Engineering Manager - Pipelines Engine
Core
Lead the Pipelines Engine team to build next-generation Runtime ETL features and Agentic Data Engineering infrastructure for the Databricks Lakeflow platform, ensuring state-of-the-art performance for processing exabytes of daily data.
Role type
Engineering Manager - Pipelines Engine
Builds
Next-gen Runtime ETL features and Agentic Data Engineering infrastructure for the Lakeflow ETL product line
Domain
Data infrastructure, distributed systems, database internals, ETL
Deliverable
production ML models | product features | infrastructure
Required skills
Managing top-tier engineering teams, building data infrastructure systems (Apache Spark, database internals), distributed systems expertise, performance optimization, product strategy implementation, technical debt management, hiring and coaching engineers
Preferred skills
Experience with product management and direct customer interaction, ensuring high quality and reliable infrastructure services, managing teams in complex technical domains
Technologies
Apache Spark, Lakeflow, Delta Lake
Responsibilities
Lead engineering team building next-generation ETL features, oversee sustained recruitment and upskilling of top-tier talent, build processes to implement product vision and strategy, manage technical debt and long-term architecture decisions, ensure team builds high quality and reliable infrastructure services
Seniority
Manager, hands-on leadership