Senior Product Manager, Agent QA & Localization Quality
Core
Building an AI-native localization stack, specifically the quality assurance infrastructure for agentic translation workflows that decides auto-publish eligibility and catches localization defects.
Role type
Senior Product Manager (AI Localization QA & Evaluation)
Builds
AI-driven product testing tools, agentic translation quality evaluation gates, and evaluation/annotation infrastructure (golden datasets, RLHF feedback loops).
Domain
AI/ML Product Management, Localization, Translation Technology
Deliverable
production ML models | product features
Required skills
Localization/translation domain expertise, AI/ML product shipping experience, LLM evaluation and eval-driven development, data fluency, cross-functional leadership
Preferred skills
Multilingual capabilities, CMS experience, Figma familiarity, crypto/fintech domain knowledge
Technologies
LLMs, Translation Management Systems (TMS), ICU/CLDR, RLHF
Responsibilities
Define quality metrics for AI translations, build automated testing tools for localization defects, manage agentic quality gates, design evaluation harnesses and golden datasets, integrate annotation workflows for linguists.
Seniority
Senior, hands-on IC