AI Agent Evaluator
Freelance / independent contractor
Core
Evaluate personalized AI conversations by comparing two AI assistants' ability to use personal context, understand user needs, and deliver helpful, safe responses.
Role type
Independent contractor AI evaluation specialist
Builds
High-quality training and evaluation data for frontier AI models
Domain
Artificial Intelligence / Machine Learning
Deliverable
production ML models
Required skills
Fluency in supported languages, strong reading comprehension, attention to detail, sound judgment, ability to explain feedback clearly
Preferred skills
Experience using AI assistants for everyday tasks, previous experience in AI evaluation or user research, ability to identify subtle differences in conversation quality
Technologies
AI assistants, connected digital services
