Expert Talent Pool, Feedback and Alignment Associate
Core
Provide structured feedback to improve AI model responses by ranking, rating, and fact-checking outputs for accuracy, helpfulness, tone, and safety.
Role type
AI model evaluation associate (data labeling)
Builds
Improved AI model responses and safety alignment
Domain
Artificial Intelligence / Machine Learning
Deliverable
production ML models
Required skills
Fact-checking, rubric application, content moderation, reasoning evaluation, policy assessment, search relevance assessment
Preferred skills
AI data labeling, preference ranking, response rating
Technologies
N/A
Responsibilities
Rank and compare model responses to identify the strongest answer; Rate responses for accuracy, helpfulness, tone, and safety using detailed rubrics; Review individual reasoning steps and label them as correct or incorrect; Write concise rationales to explain ratings and decisions; Fact-check claims using reliable sources; Evaluate responses against content policies and style guides; Assess search result relevance and provide live feedback on model outputs during sessions