Project Perseus | Data Quality Analyst - English Speakers (Europe, UK, Canadian and/ or Australian variants) - (Human-in-the-Loop AI)
Core
Audit AI model outputs and human annotator work to ensure quality, consistency, and guideline adherence in human-in-the-loop AI projects.
Role type
Data Quality Analyst (Human-in-the-Loop AI)
Builds
High-quality training data and evaluation feedback for AI systems
Domain
Artificial Intelligence / Machine Learning / Data Annotation
Deliverable
production ML models
Required skills
auditing outputs, interpreting complex guidelines, coaching/trainers, identifying patterns in human and model outputs, documenting findings, stakeholder communication
Preferred skills
experience in AI/ML data workflows, safety/compliance/policy evaluation, auditing others' work
Technologies
human-in-the-loop evaluation environments
Responsibilities
Audit DLA outputs and provide structured feedback, act as first-line support for DLAs, support onboarding and training of new DLAs, monitor workflows and escalate risks, identify patterns in human and model outputs, contribute to improving guidelines and processes
Seniority
Mid-level, hands-on IC