Quality Evaluator – Fluent English (Ecuador)
Core
Evaluate and compare responses from advanced AI models to improve their accuracy, helpfulness, and reliability.
Role type
Independent contractor quality evaluator (AI models)
Builds
High-quality training and evaluation data for frontier AI models
Domain
Artificial Intelligence / Large Language Models
Deliverable
production ML models
Required skills
English fluency, critical thinking, LLM usage experience, analytical judgment, attention to detail, instruction following
Preferred skills
Data annotation experience, analytical writing, familiarity with evaluation rubrics
Technologies
Large Language Models (LLMs)
Responsibilities
Interact with different AI models across various prompts, compare AI-generated responses side by side, assess response quality dimensions, follow detailed rating guidelines, write clear explanations for evaluation decisions
Seniority
Part-time, up to 3 months commitment
