Principal Product Manager(Work IQ)
Core
Own the end-to-end evaluation stage for AI agents, ensuring quality, accuracy, latency, cost, and trust through continuous monitoring, A/B testing, and drift detection while protecting human-in-the-loop decision boundaries.
Role type
Principal Product Manager (AI Evaluation & Platform)
Builds
Enterprise-grade AI agent evaluation suites, SDKs, CLI tools, and MCP integrations
Domain
Artificial Intelligence / Enterprise Software
Deliverable
production ML models | product features
Required skills
AI agent evaluation strategy, A/B testing design, drift detection, API product management, developer experience (DX) design, security & compliance guardrails, stakeholder alignment
Preferred skills
Agentic loop architecture, zero-touch automation, enterprise trust modeling, competitive market disruption
Technologies
SDKs, CLI, MCP integrations
Responsibilities
Define and maintain evaluation baselines for quality, accuracy, and latency; design agentic usage patterns and developer experiences; partner with security and compliance to establish safe defaults; drive market disruption and product metrics improvement; ensure auditable human-in-the-loop gate decisions.
Seniority
Principal, strategy & mentorship
