Senior Product Manager
Core
Lead product strategy for evaluating and improving the quality of AI-generated advertising creative at scale, owning the full Evals & Quality product area.
Role type
Senior Product Manager (AI Quality & Evaluation)
Builds
Scalable evaluation loops, representative datasets, judging frameworks, and customer-facing quality evidence assets.
Domain
Generative AI, Advertising Creative, Product Evaluation
Deliverable
production ML models | product features
Required skills
Product strategy, quality metric definition, evaluation methodology design, human-in-the-loop process management, dataset curation, product lifecycle management, stakeholder influence, ambiguity navigation, hypothesis testing, commercial enablement
Preferred skills
Experience with subjective domains, inter-rater reliability concepts, RFP response support, public evaluation platform management
Technologies
N/A
Responsibilities
Define long-term problem scope and success metrics for Evals & Quality; Design and manage scalable human quality-control processes; Own the golden dataset curation and maintenance; Build reusable evaluation loops for product and engineering teams; Provide quality evidence for client RFPs and enablement materials; Lead the complete product lifecycle from discovery to post-launch review.
Seniority
Senior, hands-on IC
