Senior Software Engineer, Inference
Core
Design and ship customer-facing APIs exposing new model capabilities, scaling inference infrastructure for over 1 million users, and productionizing research techniques into low-latency services.
Role type
Senior IC software engineer (inference & API)
Builds
Customer-facing APIs, inference infrastructure, SDKs, and internal tooling
Domain
AI/ML, backend services, cloud infrastructure
Deliverable
production ML models | product features | infrastructure
Required skills
backend engineering, production ML infrastructure, customer-facing API development, model behavior analysis, agile adaptation to shifting timelines
Preferred skills
experience with research-to-production workflows, SDK development
Technologies
(none explicitly listed)
Responsibilities
Design and ship customer-facing APIs; Scale inference infrastructure; Productionize research techniques; Collaborate with researchers and product teams; Contribute to backend services and tooling
Seniority
Senior, hands-on IC