Engineering Manager, Ray Data
Core
Lead the open source Ray Data team to build a Python-native data processing engine for AI workloads, handling multimodal/structured data, batch inference, and large-scale preprocessing.
Role type
First-line engineering manager (distributed systems/data infrastructure)
Builds
Ray Data open source library (streaming engine, batch inference, data connectors, performance/stability)
Domain
Distributed systems, data-intensive systems, AI/ML infrastructure
Deliverable
production ML models
Required skills
distributed systems architecture, data processing engines, Python, team leadership, open source community management, technical design review, performance optimization
Preferred skills
Ray, Spark, Flink, Beam, Apache Arrow, Iceberg, Delta Lake, GPU workloads, LLM inference
Technologies
Ray, Python, vLLM, Parquet, Iceberg, Delta Lake, Lance, cloud object storage
Responsibilities
Set technical direction and roadmap for Ray Data, drive execution of key projects, hire and coach distributed systems engineers, manage day-to-day team operations, perform hands-on code review and performance investigations, represent Ray Data in the open source community, partner with Ray Core/Train/Serve teams, communicate team work via talks and blog posts
Seniority
Manager, hands-on IC
