Human Data Quality Analyst, AI Business
Core
Analyze human data quality for AI training by investigating datasets, identifying failure modes, and building automated quality controls.
Role type
Junior IC data quality analyst (AI/human data)
Builds
Automated data-quality pipelines, validation rules, and quality measurement systems for AI model training
Domain
Artificial Intelligence / Human-in-the-loop data infrastructure
Deliverable
production ML models
Required skills
SQL, Python, statistical analysis (sampling, distributions), data visualization, analytical reasoning, pattern recognition
Preferred skills
Experience with human annotation/labeling, psychology or behavioral science, RLHF/supervised fine-tuning concepts, dashboard creation
Technologies
SQL, Python, LLM-assisted tools
Responsibilities
Run day-to-day quality measurement on live human-data programmes; investigate quality shifts and quantify impact; build data-quality pipelines with engineers; create reports and visualizations for stakeholders; support programme design with rubrics and gold sets; improve annotation design and quality processes based on findings
Seniority
Junior, early career hands-on IC
