Software Engineer, Fleet Infrastructure
Core
Design, implement, and operate infrastructure systems for model deployment and training on one of the world's largest GPU fleets.
Role type
Senior IC infrastructure engineer (GPU fleet)
Builds
Compute fleet components including job scheduling, cluster management, snapshot delivery, and CI/CD systems
Domain
AI/ML infrastructure, hyperscale compute, public cloud
Deliverable
infrastructure
Required skills
Kubernetes, public cloud platforms (Azure), programming, compute systems design
Preferred skills
AI/ML workload understanding, execution focus
Technologies
Kubernetes, Azure, blob storage
Responsibilities
Design and implement job scheduling and quota systems; build automation for Kubernetes cluster provisioning and upgrades; support research workflows with service frameworks; ensure fast model startup times via snapshot delivery and hardware caching; interface with researchers to understand workload requirements; collaborate with hardware and business teams to ensure high utilization and reliability.
Seniority
Senior, hands-on IC