CareerPlan

Senior Product Manager - Inference Platform

United StatesRemoteFull-time$228k–$285k2026-10-27 → 2026-11-10
Remote

Core

Building Nebius Token Factory, an AI inference platform for high-performance, cost-efficient workloads at scale, serving developers and managed enterprise customers.

Role type

Senior/Principal Product Manager, Inference Platform

Builds

Core platform streams for the AI inference platform, including public API, routing, performance, and reliability features

Domain

Cloud infrastructure, AI/ML, Inference optimization

Deliverable

production ML models

Required skills

Technical platform product shipping, AI inference architecture (model serving, distributed systems), Cross-functional leadership, B2B/enterprise sales experience, Market research and product strategy

Preferred skills

Post-training experience, Third-party technical partnerships

Technologies

AI inference platforms, Distributed systems, Public APIs

Responsibilities

Own the roadmap and outcomes for a part of the inference platform, Align cross-functional engineering teams, Work with engineering and research to make inference scalable and cost-efficient, Stay close to customers through research and PoCs, Track the market and turn insights into product bets