Senior Manager, Product Manager - AI Acceleration
Core
Lead strategic product definition and delivery of a centralized agentic evaluation and observability framework to enable cross-team tool reuse and continuous model improvement.
Role type
Senior Manager, Product Management (AI/LLM Agents)
Builds
Foundational infrastructure for multi-tier evaluation systems (deterministic guardrails, LLM-as-Judge, offline golden-dataset validation) for agentic ecosystems
Domain
Financial Services / Generative AI / LLM Operations
Deliverable
production ML models | infrastructure
Required skills
Product lifecycle management, cross-functional leadership, language model research, Generative AI, AI agent design, product-centric problem solving, technical strategy alignment
Preferred skills
Translating business strategy into consumer-facing digital products
Technologies
LLM-as-Judge, streaming data platforms, deterministic guardrails, golden-dataset validation
Responsibilities
Lead large cross-functional teams through the entire product lifecycle from research to shipping, shape product strategy for AI capabilities, partner with engineering and data scientists to build evaluation frameworks, standardize agent performance auditing across the organization, advocate for next-generation solutions with senior leaders
Seniority
Senior, hands-on IC with strategic leadership