Senior Production Engineer, Managed AI
Core
Design and operate reliable managed AI services, focusing on serving and scaling LLM workloads to ensure high availability and performance.
Role type
Senior Production Engineer (AI Infrastructure)
Builds
Managed AI services, distributed AI pipelines, and inference services
Domain
AI Infrastructure / Cloud Computing / Distributed Systems
Deliverable
production ML models
Required skills
Distributed systems design, Large Language Models (LLMs), SRE practices, Python/Go/Java/C++, Kubernetes, Observability, Fault-tolerant system design
Preferred skills
Scaling inference or training workloads for LLMs
Technologies
Kubernetes, Python, Go, Java, C++, LLMs
Responsibilities
Design and operate reliable managed AI services, Build automation and reliability tooling, Define and improve SLIs/SLOs, Collaborate on optimizing training and inference clusters, Automate observability and performance tuning, Investigate and resolve reliability issues
Seniority
Senior, hands-on IC
