Staff Backend Software Engineer
Core
Build LLM infrastructure powering trillions of tokens per week for customers through partner models and self-hosted models, improving reliability, latency, and efficiency of distributed AI workloads.
Role type
Staff Backend Software Engineer (AI Infrastructure)
Builds
LLM infrastructure, distributed AI workloads, and developer platforms for AI workflows
Domain
Artificial Intelligence / Cloud Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Backend engineering, distributed systems, scalable APIs, cloud-native infrastructure, service-oriented architecture, system observability
Preferred skills
Real-time serving, ML infrastructure, GPU orchestration, OSS contributions (MLflow, PyTorch, Ray, vLLM, SGLang), developer platform experience
Technologies
Scala, Go, Python, OpenAI, Anthropic, Gemini, Qwen, GPT-OSS, Llama, SageMaker, Vertex AI, Azure ML
Responsibilities
Build LLM infrastructure for partner and self-hosted models, improve reliability and efficiency of distributed AI workloads, collaborate with platform and ML teams, shape developer and data scientist experiences
Seniority
Staff, high-agency IC with strategic impact
