CareerPlan

Expert Talent Pool, Feedback and Alignment (Associate, 0-5 Years)

RemoteFull-time2026-11-16 → 2026-11-18

Core

Evaluate and improve AI model outputs by comparing responses, rating accuracy/safety, fact-checking claims, and labeling reasoning steps.

Role type

Associate AI model evaluation specialist

Builds

High-quality, safe, and accurate AI model responses and search results

Domain

Artificial Intelligence / Machine Learning

Deliverable

production ML models

Required skills

Meticulous attention to detail, ability to apply rubrics consistently, fact-checking, content moderation, writing/editing

Preferred skills

Experience with AI data evaluation platforms, search quality rating, ads rating

Technologies

AI data evaluation platforms, search quality rating tools

Responsibilities

Compare and rank model responses, Rate answers for accuracy and safety, Label reasoning steps and write rationales, Fact-check claims against reliable sources, Evaluate search result relevance, Provide live feedback on model outputs