Engineering Manager - Streaming
Core
Leading the Spark™ Structured Streaming team to build state-of-the-art stream processing capabilities for the Databricks Intelligence Platform, focusing on advanced features, performance optimization, and architecture reimagining.
Role type
Engineering Manager (Streaming Systems)
Builds
Spark™ Structured Streaming engine (open source and Databricks-specific components)
Domain
Big Data, Distributed Systems, Database Internals
Deliverable
production ML models
Required skills
Distributed systems, database internals, query processing, query optimization, performance optimization, team leadership, technical architecture, product roadmap execution
Preferred skills
Managing distributed teams, cross-functional collaboration with product management and customers
Technologies
Apache Spark™
Responsibilities
Leading engineering team development and promotion of the engine in OSS and Databricks Data Intelligence Platform, overseeing recruitment and upskilling of top-tier talent, implementing processes to execute product vision and strategy, managing technical debt and long-term architecture decisions, driving Stream Processing adoption across the product portfolio
Seniority
Senior, hands-on IC with leadership responsibilities
