Lead Product Manager— Agent Supply & Quality - EMEA Remote
Core
Lead Product Manager owning the supply side of an AI agent marketplace, ensuring quality, coverage, and reliability of agents for marketing campaigns.
Role type
Lead Product Manager (AI Agents & Marketplace)
Builds
An agentic OS for marketing, including core agents, an agent builder for 3P developers, and evaluation frameworks.
Domain
Generative AI, Marketing Technology, Agent Orchestration
Deliverable
production ML models | product features
Required skills
AI product management, evaluation framework design, 3P integration strategy, ecosystem building, technical credibility in LLMs, data-driven decision making
Preferred skills
Marketing or creative tech background, experience with enterprise brand safety, rapid prototyping
Technologies
LLMs, agentic workflows, automated evaluation pipelines, SDKs
Responsibilities
Own the By Pencil agent roadmap including quality bars and release criteria; Define and scale automated evaluation pipelines; Drive third-party integrations from prioritization to launch; Build the agent builder experience and revenue share model; Identify gaps in agent coverage and build the case for new builds; Partner with engineering on technical constraints and tradeoffs; Instrument metrics for quality and coverage.
Seniority
Lead, hands-on IC with strategic ownership