Senior Staff Software Engineer, AI Runtime
Core
Architect and lead the long-term technical direction of AI Runtime, a serverless platform enabling GPU training of any size for enterprise customers and internal research teams.
Role type
Senior Staff Software Engineer (AI Runtime Infrastructure)
Builds
Serverless GPU training infrastructure, reliability systems, and developer experience for large-scale model training.
Domain
Cloud Infrastructure, High-Performance Computing (HPC), Distributed Systems, AI/ML Training
Deliverable
production ML models
Required skills
Large-scale distributed systems, GPU training (FSDP, DeepSpeed, Megatron), GPU performance & architecture, Training resilience patterns, Multi-tenant cloud platforms, Technical direction & strategy
Preferred skills
PhD in CS or related field, Experience with high-speed interconnects, Background in building cloud products as products
Technologies
FSDP, DeepSpeed, Megatron, GPU accelerators, Kubernetes (implied by orchestration), Python/C++ (implied by kernels)
Responsibilities
Drive AI Runtime's architecture and long-term technical direction; Define reliability and observability strategy for growing fleets; Shape developer experience for people and agents; Anticipate industry trends and choose technical bets for new GPU generations; Solve hardest multi-node training problems (orchestration, scheduling, data loading, checkpointing); Optimize efficiency across model architectures and GPU accelerators; Mentor senior engineers and align teams on technical trade-offs.
Seniority
Senior Staff, hands-on IC with strategic leadership
