CareerPlan

Principal Product Manager, AI Infrastructure and Orchestration

Washington, US - RemoteFull-time2026-08-18 → 2026-11-19

Core

Own the control plane layer for deploying, scaling, and governing AI agents and models on Kubernetes clusters and heterogeneous accelerators for regulated, air-gapped, and sovereign enterprise deployments.

Role type

Principal Product Manager, AI Infrastructure and Orchestration

Builds

The deployment and workload API, placement/capacity logic, autoscaling signals, agent runtime isolation, traffic routing, governance/audit, metering, and reliability SLOs for the DataRobot platform.

Domain

AI Infrastructure, Cloud Native, Kubernetes, GPU/Accelerator Orchestration

Deliverable

production ML models

Required skills

Product management for infrastructure/cloud services, Kubernetes architecture (scheduler, CRDs, operators, RBAC), GPU/accelerator behavior and topology-aware placement, multi-tenancy and isolation models, API product design and contract management, technical writing and prototyping, matrixed team leadership.

Preferred skills

Service networking (ingress, load balancing, TLS, private links), modern serving stacks (vLLM, KV cache, batching), agentic workload patterns (session affinity, tool-call fan-out), sovereign/air-gapped deployment experience, CNCF contributions.

Technologies

Kubernetes, Kubernetes API server, CRDs, Operators, Device Plugins, vLLM, MIG, Docker/container runtimes

Responsibilities

Define API contracts and lifecycle semantics for workload deployment; design placement and capacity allocation strategies across heterogeneous accelerators; establish autoscaling policies and cost-versus-latency trade-offs; define agent runtime isolation and state management; design traffic routing and private connectivity for customer networks; establish governance, audit trails, and access control policies; define metering, quota, and pricing models; set reliability SLOs and error budgets for the platform layer.

Seniority

Principal, hands-on IC with strategic influence