Evaluation Science Lead
Core
Define and validate evaluation frameworks for multilingual Globalization AI solutions across 50+ languages and markets.
Role type
Senior IC evaluation science lead
Builds
Production ML models
Domain
AI / NLP / Globalization
Deliverable
production ML models
Required skills
statistical methodology, experimental design, human annotation protocols, LLM-as-judge systems, data analysis, R, Python, SQL
Preferred skills
generative AI evaluation, causal inference, applied linguistics, benchmark design
Technologies
R, Python, SQL
Responsibilities
Design statistical methodologies for model evaluation; Architect scalable workflows blending human annotation with automated systems; Translate evaluation data into actionable recommendations for engineering; Build continuous performance monitoring and drift-detection systems; Establish feedback loops to refine evaluation rubrics.
Seniority
Senior, hands-on IC