Software Engineer, Agent Infrastructure
Core
Building and scaling systems to train highly capable agentic models and launching production platforms for hundreds of millions of users.
Role type
Senior IC software engineer (AI infrastructure)
Builds
Novel container orchestration platform, FastAPI/gRPC APIs, and production execution systems for AI agents.
Domain
AI research infrastructure, large-scale distributed systems, cloud platforms
Deliverable
production ML models | infrastructure
Required skills
large-scale ML infrastructure, container orchestration, API development, infrastructure-as-code, performance optimization, virtualization technologies
Preferred skills
building systems from 0-1, scaling to massive compute clusters, optimizing runtime performance, solving ambiguous infrastructure problems
Technologies
FastAPI, gRPC, Terraform, Kata, Firecracker, gVisor, Sysbox, Kubernetes
Responsibilities
Push massive compute clusters to their limits; Develop and maintain FastAPI and gRPC APIs; Use Terraform to stand up and evolve complex infrastructure; Collaborate with research teams to optimize systems for novel AI training runs.
Seniority
Senior, hands-on IC
