Software Engineer, ML Serving Platform
Core
Build the next generation of DoorDash's ML serving platform, connecting request routing, online feature retrieval, and model inference on CPU/GPU infrastructure to power search, recommendations, and logistics.
Role type
Senior IC platform engineer (ML serving infrastructure)
Builds
Self-serve infrastructure for model deployment, inference frameworks, and global serving architecture
Domain
Food delivery / ML infrastructure / Distributed systems
Deliverable
production ML models
Required skills
Backend/systems programming (Java, Kotlin, Go, C++, Python), distributed systems fundamentals, Kubernetes deployment and autoscaling, production debugging, performance profiling, API design
Preferred skills
ML inference infrastructure, online feature retrieval, self-serve developer platforms, open source integration, CPU/GPU performance profiling
Technologies
Kubernetes, CPU, GPU, Java, Kotlin, Go, C++, Python
Responsibilities
Build tools, APIs, and workflows for internal teams to deploy and operate models independently; Evaluate and integrate evolving inference frameworks and open source models; Improve systems for routing prediction requests and retrieving online features; Build modular components for disaggregated serving architecture; Optimize Kubernetes workloads for latency, availability, and resource efficiency; Develop integrations and migration tooling for platform adoption; Use benchmarking and tracing to identify bottlenecks and improve production reliability.
Seniority
Senior, hands-on IC
