Principal Product Manager, AI Infrastructure and Orchestration
Core
Own the control plane layer for deploying, scaling, and governing AI agents and models on Kubernetes clusters and heterogeneous accelerators for regulated, air-gapped, and sovereign enterprise deployments.
Role type
Principal Product Manager, AI Infrastructure and Orchestration
Builds
The deployment and workload API, placement/capacity logic, autoscaling signals, agent runtime isolation, traffic routing, governance/audit, metering, and reliability SLOs for the DataRobot platform.
Domain
AI Infrastructure, Cloud Native, Kubernetes, GPU/Accelerator Orchestration
Deliverable
production ML models
Required skills
Product management for infrastructure/cloud services, Kubernetes architecture (scheduler, CRDs, operators, RBAC), GPU/accelerator behavior and topology-aware placement, multi-tenancy and isolation models, API product design and contract management, technical writing and prototyping, matrixed team leadership.
Preferred skills
Service networking (ingress, load balancing, TLS, private links), modern serving stacks (vLLM, KV cache, batching), agentic workload patterns (session affinity, tool-call fan-out), sovereign/air-gapped deployment experience, CNCF contributions.
Technologies
Kubernetes, Kubernetes API server, CRDs, Operators, Device Plugins, vLLM, MIG, Docker/container runtimes
Responsibilities
Define API contracts and lifecycle semantics for workload deployment; design placement and capacity allocation strategies across heterogeneous accelerators; establish autoscaling policies and cost-versus-latency trade-offs; define agent runtime isolation and state management; design traffic routing and private connectivity for customer networks; establish governance, audit trails, and access control policies; define metering, quota, and pricing models; set reliability SLOs and error budgets for the platform layer.
Seniority
Principal, hands-on IC with strategic influence