Principal Technical Product Manager, Evaluations & Governance
Core
Own product strategy for evaluations and governance capabilities enabling safe, scaled agentic AI deployment in a major bank, assessing AI system quality and safety before/after deployment.
Role type
Principal Technical Product Manager (AI Governance & Evaluation)
Builds
Production-ready evaluation tooling, governance frameworks, and risk/compliance reporting for AI systems
Domain
Financial Services / Responsible AI / AI Governance
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Product strategy & roadmap ownership, AI/ML system evaluation, LLM API integration, regulated industry compliance, system design & API patterns, RAG architecture, stakeholder management, team leadership
Preferred skills
Leading product teams, converting regulatory requirements to automated tooling, defining shared interfaces, AI safety & model risk management, observability platforms, AI-specific financial regulations (OSFI, NIST, SR 26-2, ISO/IEC 42001), scaling new functions
Technologies
LLM APIs (Anthropic, OpenAI, Azure OpenAI), Vector databases, RAG, Observability platforms
Responsibilities
Define end-to-end product strategy and multi-year roadmap for AI evaluation/governance; Lead discovery and translate stakeholder input into product requirements; Partner with engineering on feasibility and delivery sequencing; Represent capability area to risk, audit, and compliance stakeholders; Build and mentor a team of product managers; Define success metrics and value messaging for launches
Seniority
Principal, hands-on IC with people leadership
