CareerPlanSign in

Senior Manager, Product Manager - AI Acceleration

New York, NY, US💼 Full-time💰 $200,700–$200,700🗓 2026-08-13 → 2026-09-27

Core

Lead strategic product definition and delivery of a centralized agentic evaluation and observability framework to enable cross-team tool reuse and continuous model improvement.

Role type

Senior Manager, Product Management (AI/LLM Agents)

Builds

Foundational infrastructure for multi-tier evaluation systems (deterministic guardrails, LLM-as-Judge, offline golden-dataset validation) for agentic ecosystems

Domain

Financial Services / Generative AI / LLM Operations

Deliverable

production ML models | infrastructure

Required skills

Product lifecycle management, cross-functional leadership, language model research, Generative AI, AI agent design, product-centric problem solving, technical strategy alignment

Preferred skills

Translating business strategy into consumer-facing digital products

Technologies

LLM-as-Judge, streaming data platforms, deterministic guardrails, golden-dataset validation

Responsibilities

Lead large cross-functional teams through the entire product lifecycle from research to shipping, shape product strategy for AI capabilities, partner with engineering and data scientists to build evaluation frameworks, standardize agent performance auditing across the organization, advocate for next-generation solutions with senior leaders

Seniority

Senior, hands-on IC with strategic leadership

Sourced via workday · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.