Senior Software Engineer, Inference
Core
Design and ship customer-facing APIs for new model capabilities, scaling inference infrastructure to support over 1 million users.
Role type
Senior IC backend engineer (ML inference)
Builds
Customer-facing APIs, inference infrastructure, SDKs, and internal tooling
Domain
AI/ML, cloud infrastructure
Deliverable
production ML models
Required skills
backend engineering, building ML infrastructure, designing production APIs, understanding model behavior, operating amid ambiguity
Preferred skills
collaboration with researchers and customers, product design input
Technologies
N/A
Responsibilities
Design and ship customer-facing APIs for new model capabilities; Scale inference infrastructure to support more than 1 million API users; Partner with researchers to productionize new techniques; Collaborate with customers and Applied teams to inform product design and research direction; Contribute to backend services, inference infrastructure, SDKs, and internal tooling
Seniority
Senior, hands-on IC
