CareerPlan

Expert Talent Pool, Feedback and Alignment Associate

RemoteFull-time2026-11-15 → 2026-11-16

Core

Provide structured feedback to improve AI model responses by ranking, rating, and fact-checking outputs for accuracy, helpfulness, tone, and safety.

Role type

AI model evaluation associate (data labeling)

Builds

Improved AI model responses and safety alignment

Domain

Artificial Intelligence / Machine Learning

Deliverable

production ML models

Required skills

Fact-checking, rubric application, content moderation, reasoning evaluation, policy assessment, search relevance assessment

Preferred skills

AI data labeling, preference ranking, response rating

Technologies

N/A

Responsibilities

Rank and compare model responses to identify the strongest answer; Rate responses for accuracy, helpfulness, tone, and safety using detailed rubrics; Review individual reasoning steps and label them as correct or incorrect; Write concise rationales to explain ratings and decisions; Fact-check claims using reliable sources; Evaluate responses against content policies and style guides; Assess search result relevance and provide live feedback on model outputs during sessions