Member of Technical Staff (Software Engineer, Model Platform)
Core
Design and evolve the model serving platform connecting products and research systems with inference layers to enable fast, reliable model adoption and experimentation.
Role type
Senior IC software engineer (model platform infrastructure)
Builds
High-throughput model serving infrastructure and core abstractions for distributed AI systems
Domain
AI infrastructure / Distributed systems
Deliverable
production ML models
Required skills
Large-scale system design, Rust, Python, Cloud infrastructure (AWS), Kubernetes, High availability engineering, Production debugging, System reliability, API design, Experimentation frameworks
Preferred skills
Frontier model failure mode analysis, Distributed systems optimization, Developer experience (DX) design
Technologies
Rust, Python, AWS, Kubernetes
Responsibilities
Design core abstractions for the model serving platform, Lead high-conviction technical decisions for infrastructure evolution, Write production code for a service serving hundreds of millions of requests daily, Ensure high reliability and performance for model inference layers
Seniority
Senior, hands-on IC