Software Engineer, Inference
Core
Own the reliability, scale, and efficiency of production inference systems serving live traffic for AI models.
Role type
Senior IC systems engineer (inference)
Builds
Tinker's multi-tenant serving platform and production inference systems
Domain
AI/ML infrastructure and distributed systems
Deliverable
production ML models
Required skills
Python, Go, distributed systems, observability, incident response, capacity planning
Preferred skills
LLM inference operations, deployment systems (canary/blue-green), GPU/TPU cost optimization, inference techniques (batching/caching/quantization)
Technologies
Python, Go, GPU, TPU
Responsibilities
Operate and scale production inference systems, own model rollout processes, build observability and alerting, partner on productionizing serving techniques, lead incident response, design for graceful degradation and failover, manage capacity and cost tradeoffs
Seniority
Senior, hands-on IC