CareerPlanSign in

Staff Technical Program Manager, Managed Intelligence

San Francisco, CA - US💼 Full-time💰 $193,050–$193,050🗓 2026-05-20 → 2026-09-25

Core

Own end-to-end program delivery for the Managed Inference platform, connecting model engineering, IaaS, and data center operations to deliver reliable, scalable LLM workloads.

Role type

Staff Technical Program Manager (AI Infrastructure)

Builds

Production-ready Managed Inference platform for AI-native companies

Domain

AI Infrastructure / Cloud Computing / Data Centers

Deliverable

production ML models

Required skills

End-to-end program delivery, LLM inference and model serving knowledge, Multi-tenant systems experience, Fine-tuning and alignment awareness, Low-structure execution, Executive communication, Cross-functional influence

Preferred skills

Experience governing model onboarding programs across GPU generations, Coaching or mentoring junior TPMs, Background at a Series D to Series F company or hyperscaler

Technologies

CUDA, ROCm, GPU generations

Responsibilities

Own multi-quarter release planning and dependency governance, Drive model version rollouts and inference optimization campaigns, Coordinate across Model Engineering, IaaS, and Data Center Operations, Surface risks across model serving and capacity constraints, Build lightweight execution frameworks and dashboards, Own pre-launch planning for model onboarding including firmware and driver validation

Seniority

Staff, hands-on IC with strategic scope

Sourced via ashby · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.