Expert Talent Pool, Feedback and Alignment (Associate, 0-5 Years)
Core
Evaluate and improve AI model outputs by comparing responses, rating accuracy/safety, fact-checking claims, and labeling reasoning steps.
Role type
Associate AI model evaluation specialist
Builds
High-quality, safe, and accurate AI model responses and search results
Domain
Artificial Intelligence / Machine Learning
Deliverable
production ML models
Required skills
Meticulous attention to detail, ability to apply rubrics consistently, fact-checking, content moderation, writing/editing
Preferred skills
Experience with AI data evaluation platforms, search quality rating, ads rating
Technologies
AI data evaluation platforms, search quality rating tools
Responsibilities
Compare and rank model responses, Rate answers for accuracy and safety, Label reasoning steps and write rationales, Fact-check claims against reliable sources, Evaluate search result relevance, Provide live feedback on model outputs