Product Manager, Inference Experience
Core
Own the developer experience for AI inference, from model discovery to production deployment and optimization.
Role type
Senior Product Manager, AI Infrastructure
Builds
Model APIs, Dedicated Inference, Model Evaluations, and Model Library
Domain
AI Infrastructure / Developer Experience
Deliverable
production ML models
Required skills
AI/ML product strategy, model serving, GPU economics, developer experience, cross-functional leadership, technical judgment
Preferred skills
ML infrastructure design, terminal and console tooling, software development
Technologies
PyTorch, TensorRT-LLM, vLLM, SGLang, NVIDIA Dynamo
Responsibilities
Own product strategy and roadmap for inference offerings; enable developers to discover, evaluate, deploy, and manage models via APIs/SDKs/CLI; partner with engineering/research to productize technical advances; prioritize models and workloads; drive pricing and commercialization; conduct customer and developer research
Seniority
Senior, hands-on IC