CareerPlan

Product Manager, Inference Experience

San FranciscoFull-time2026-11-11 → 2026-11-18
On-site · United States

Core

Own the developer experience for AI inference, from model discovery to production deployment and optimization.

Role type

Senior Product Manager, AI Infrastructure

Builds

Model APIs, Dedicated Inference, Model Evaluations, and Model Library

Domain

AI Infrastructure / Developer Experience

Deliverable

production ML models

Required skills

AI/ML product strategy, model serving, GPU economics, developer experience, cross-functional leadership, technical judgment

Preferred skills

ML infrastructure design, terminal and console tooling, software development

Technologies

PyTorch, TensorRT-LLM, vLLM, SGLang, NVIDIA Dynamo

Responsibilities

Own product strategy and roadmap for inference offerings; enable developers to discover, evaluate, deploy, and manage models via APIs/SDKs/CLI; partner with engineering/research to productize technical advances; prioritize models and workloads; drive pricing and commercialization; conduct customer and developer research

Seniority

Senior, hands-on IC