Project Perseus | Data Labeling Associate - Italian Speakers (Human-in-the-Loop AI)
Core
Evaluate AI model outputs, perform audit-based reviews of data and model behavior, and contribute to improving evaluation frameworks for GenAI systems.
Role type
Data Labeling Associate (Human-in-the-Loop AI)
Builds
High-quality feedback and insights to improve AI model behavior and safety standards
Domain
Generative AI, Data Quality, Model Evaluation
Deliverable
production ML models
Required skills
Native-level Italian, B2+ English, complex writing rules application, safety considerations in GenAI, critical thinking, judgment in ambiguous situations
Preferred skills
Data quality, QA, annotation, or analysis experience
Technologies
GenAI systems, evaluation frameworks
Responsibilities
Evaluate AI model outputs and provide structured feedback, Perform audit-based reviews identifying patterns and failure modes, Apply guidelines and flag real-world mismatches, Contribute to refining evaluation frameworks, Identify trends in model performance, Document findings clearly
Seniority
Mid-level, hands-on IC