Staff Product Manager, AI Inference
Core
Lead strategic efforts in shaping and developing cutting-edge AI inference services to drive innovation and business outcomes for customers.
Role type
Staff Product Manager (AI Inference)
Builds
AI inference services, cloud-native architectures, and product portfolios for foundational model inference
Domain
AI/ML, Cloud Infrastructure, GPU Computing
Deliverable
product features
Required skills
AI/ML workloads, foundation model inference, inference engines (vllm, SGLang, TensorRT-llm, llm-d), inference optimization (quantization, speculative decoding), cloud infrastructure (GPUs), cloud-native architectures (Kubernetes, microservices), product strategy, roadmap development, cross-functional leadership, customer engagement, market analysis, go-to-market strategy
Preferred skills
MBA, experience in AI and cloud space
Technologies
vllm, SGLang, TensorRT-llm, llm-d, Kubernetes, microservices, GPUs
Responsibilities
Refine product strategy for AI application cloud services, own the product roadmap for AI inference services, stay current on AI/ML advancements, define product portfolio, collaborate with key customers, lead cross-functional teams, analyze market trends, develop go-to-market strategies
Seniority
Staff, strategic leadership with hands-on technical expertise
