Staff Backend Software Engineer
Core
Build LLM infrastructure powering trillions of tokens per week for customers through partner and self-hosted models, improving reliability, latency, and efficiency of distributed AI workloads.
Role type
Staff Backend Software Engineer (AI Infrastructure)
Builds
LLM serving infrastructure, distributed AI workloads, and developer platforms for AI workflows
Domain
AI Infrastructure / Cloud Native / Distributed Systems
Deliverable
production ML models | infrastructure
Required skills
Backend engineering, distributed systems, scalable APIs, cloud-native infrastructure, service-oriented architecture, system observability
Preferred skills
Real-time serving, ML infrastructure, GPU orchestration, OSS contributions (MLflow, PyTorch, Ray, vLLM, SGLang), developer platform experience
Technologies
Scala, Go, Python
Responsibilities
Build LLM infrastructure for partner and self-hosted models; Improve reliability and efficiency of distributed AI workloads; Collaborate with platform, infra, and ML teams; Shape developer and data scientist experiences on Databricks
Seniority
Staff, high-agency IC with strategic impact