Senior Product Manager –AI Inference Software
Core
Own the framework-layer inference product strategy for ROCm, translating customer and ecosystem signals into roadmap decisions for production AI inference on AMD Instinct hardware.
Role type
Senior Product Manager (AI Inference Infrastructure)
Builds
Framework-layer software stack for AI inference enabling production workloads from single-GPU to rack-scale deployments
Domain
AI Infrastructure / GPU Computing / Open Source Software
Deliverable
production ML models
Required skills
AI inference infrastructure, inference engines, serving and orchestration, memory management, distributed inference, GPU software stack, open-source community engagement, technical product leadership
Preferred skills
vLLM, SGLang, AMD ATOM, llm-d, cloud infrastructure, high-performance computing, technical writing, conference talks
Technologies
ROCm, AMD Instinct, vLLM, SGLang, AMD ATOM, llm-d
Responsibilities
Define product strategy and roadmap for inference frameworks; Partner with engineering teams on inference engines, serving, and orchestration; Engage with open-source community maintainers and developers; Work with strategic AI infrastructure customers to translate needs into product decisions
Seniority
Senior, hands-on IC
