AI Infrastructure Engineer [Tooling]
Core
Design, build, and own tooling and services that take AI agents from development to production in customer clouds, including CLIs, controllers, and internal services.
Role type
Senior IC AI Infrastructure Engineer (Tooling)
Builds
Internal CLIs, SDKs, services, Kubernetes operators, and MLOps workflows for multi-agent systems
Domain
AI Infrastructure / Cloud Platform / MLOps
Deliverable
production ML models
Required skills
Python, Go, Kubernetes (operators/controllers), Terraform, vLLM, MLOps, CI/CD, GitOps, Cloud (Azure/GCP/AWS/Oracle), Networking
Preferred skills
GPU infrastructure, Agent frameworks (LangGraph, MCP), LLM observability (OpenTelemetry, Langfuse), FluxCD/ArgoCD, DevSecOps
Technologies
Python, Go, Kubernetes, Terraform, vLLM, Azure, GCP, AWS, Oracle Cloud, GitOps, OpenTelemetry, Langfuse
Responsibilities
Build internal CLIs, SDKs, and services for AI agent lifecycle management; Deploy and tune LLM inference using vLLM; Write Kubernetes operators and custom controllers; Design and operate production-grade AI infrastructure on Kubernetes and Terraform; Improve observability for AI systems; Design and own CI/CD for infrastructure and model releases
Seniority
Senior, hands-on IC