Senior Product Manager, Multilingual AI and Evals
Core
Building an AI-native localization stack including agentic translation workflows, quality assurance systems, and evaluation infrastructure for multilingual AI agents.
Role type
Senior Product Manager (AI Localization & Evaluation)
Builds
Agentic translation pipelines, AI-driven localization testing tools, evaluation harnesses, golden datasets, and annotation tooling.
Domain
Artificial Intelligence, Localization, Global Product Delivery
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Product management, AI agent system building/evaluation, platform building, cross-functional leadership, multi-market product shipping, data-driven quality assessment
Preferred skills
Localization/translation domain expertise, TMS tools experience, bilingual/multilingual capabilities, crypto/fintech experience
Technologies
TMS tools (Phrase, Smartling), ICU/CLDR
Responsibilities
Enhance quality gates for agentic translation pipelines, build AI-driven tools to detect localization defects, construct evaluation infrastructure with golden datasets and annotation workflows, integrate annotation tools for linguists, diagnose systematic quality issues in AI outputs.
Seniority
Senior, hands-on IC
