Project Perseus | Data Quality Analyst - Italian Speakers (Human-in-the-Loop AI)
Core
Audit AI model outputs and guide Data Labeling Associates (DLAs) to ensure high-quality data for human-in-the-loop AI systems.
Role type
Senior IC data quality analyst (human-in-the-loop AI)
Builds
High-quality training data for AI models
Domain
AI/ML data workflows, human-in-the-loop evaluation
Deliverable
production ML models
Required skills
data annotation, content quality assurance, auditing, guideline interpretation, stakeholder communication, workflow monitoring, pattern recognition, documentation, coaching
Preferred skills
AI/ML data workflows experience, safety/compliance content evaluation, experience reviewing others' work
Technologies
human-in-the-loop evaluation environments
Responsibilities
Audit DLA outputs and provide structured feedback, act as first-line support for DLAs, support onboarding and training of new DLAs, monitor workflows and escalate risks, identify patterns and edge cases in outputs, contribute to improving guidelines and processes
Seniority
Mid-level, hands-on IC