CareerPlan

AI Infrastructure Engineer [Tooling]

Remote in the U.S.Full-time2026-10-29 → 2026-11-19
Based in United States

Core

Design, build, and own tooling and services that take AI agents from development to production in customer clouds, including CLIs, controllers, and internal services.

Role type

Senior IC AI Infrastructure Engineer (Tooling)

Builds

Internal CLIs, SDKs, services, Kubernetes operators, and MLOps workflows for multi-agent systems

Domain

AI Infrastructure / Cloud Platform / MLOps

Deliverable

production ML models

Required skills

Python, Go, Kubernetes (operators/controllers), Terraform, vLLM, MLOps, CI/CD, GitOps, Cloud (Azure/GCP/AWS/Oracle), Networking

Preferred skills

GPU infrastructure, Agent frameworks (LangGraph, MCP), LLM observability (OpenTelemetry, Langfuse), FluxCD/ArgoCD, DevSecOps

Technologies

Python, Go, Kubernetes, Terraform, vLLM, Azure, GCP, AWS, Oracle Cloud, GitOps, OpenTelemetry, Langfuse

Responsibilities

Build internal CLIs, SDKs, and services for AI agent lifecycle management; Deploy and tune LLM inference using vLLM; Write Kubernetes operators and custom controllers; Design and operate production-grade AI infrastructure on Kubernetes and Terraform; Improve observability for AI systems; Design and own CI/CD for infrastructure and model releases

Seniority

Senior, hands-on IC