CareerPlan

Model Operations Lead, AI Gateway

Austin, TXFull-time2026-10-26 → 2026-11-10

Core

Lead the models team to manage AI Gateway's catalog of inference models, ensuring reliability, accurate pricing, and intelligent auto-routing for developers.

Role type

Senior People Manager (Model Operations Lead)

Builds

AI Gateway platform (model catalog, auto-routing, observability, metering)

Domain

Cloud Infrastructure / AI Inference / Model Operations

Deliverable

production ML models

Required skills

People leadership, technical launches, model ecosystem expertise, SRE mindset, agent workflows, automation

Preferred skills

Inference provider experience, evals/ranking systems, Cloudflare Workers, Replicate

Technologies

TypeScript, Python, Rust, cURL, terminal tools

Responsibilities

Hire and grow the models team, run end-to-end model launches, maintain catalog reliability and health, build model intelligence for auto-routing, manage partner expectations, drive operational scalability through automation

Seniority

Senior, hands-on IC with people management