Technical Program Manager, Inference
Core
Lead end-to-end program management for CoreWeave's scalable, reliable production inference services, ensuring successful delivery of customer-facing infrastructure and platform capabilities.
Role type
Senior Technical Program Manager (Inference Platform)
Builds
Serverless and dedicated inference services for researchers, engineers, and enterprise customers
Domain
AI/ML Infrastructure, Cloud Computing, Distributed Systems
Deliverable
production ML models | infrastructure
Required skills
Technical program management, distributed systems, cloud infrastructure, AI/ML platform engineering, cross-functional leadership, launch readiness, runtime optimization, customer onboarding, observability tooling, release validation
Preferred skills
GPU compute, cloud-native architectures, performance optimization, inference-serving systems, model onboarding workflows, high-growth environment execution
Technologies
GPU compute, cloud-native architectures, inference-serving systems, observability tooling
Responsibilities
Drive end-to-end program management for inference platform initiatives spanning reliability, customer onboarding, launch readiness, and runtime optimization; Lead cross-functional programs for customer onboarding across dedicated and serverless inference offerings; Drive launch readiness for new inference capabilities by aligning teams around real customer outcomes; Partner with engineering and product to define and deliver roadmap outcomes for latency, throughput, uptime, operational quality, and price-performance; Coordinate multi-team execution across platform, infrastructure, and customer-facing teams to deliver reliable and scalable inference services; Build and operationalize success metrics, dashboards, launch gates, and review cadences to measure service reliability, onboarding readiness, efficiency, and quality across the inference stack; Establish repeatable processes for release validation, performance regression tracking, launch management, and postmortem follow-through
Seniority
Senior, hands-on IC
