CareerPlan

Software Engineer, Inference

San FranciscoFull-time$300k–$400k2026-10-02 → 2026-11-19
On-siteVisa sponsorship offered

Core

Own the reliability, scale, and efficiency of production inference systems serving live traffic for AI models.

Role type

Senior IC systems engineer (inference)

Builds

Tinker's multi-tenant serving platform and production inference systems

Domain

AI/ML infrastructure and distributed systems

Deliverable

production ML models

Required skills

Python, Go, distributed systems, observability, incident response, capacity planning

Preferred skills

LLM inference operations, deployment systems (canary/blue-green), GPU/TPU cost optimization, inference techniques (batching/caching/quantization)

Technologies

Python, Go, GPU, TPU

Responsibilities

Operate and scale production inference systems, own model rollout processes, build observability and alerting, partner on productionizing serving techniques, lead incident response, design for graceful degradation and failover, manage capacity and cost tradeoffs

Seniority

Senior, hands-on IC