Human Data Quality Engineer (Founding Team)
Core
Designing quality frameworks and building scalable systems to ensure high-quality human data for training advanced AI models.
Role type
Founding team Human Data Quality Engineer (AI/ML)
Builds
Quality infrastructure, evaluation rubrics, automated checks, and dashboards for human data programs.
Domain
Artificial Intelligence / Machine Learning / Human Data Operations
Deliverable
production ML models
Required skills
Python, SQL, machine learning pipelines, statistical thinking, data analysis, system architecture, stakeholder management, ambiguity navigation
Preferred skills
LLM evaluation, RLHF, AI safety, red teaming, annotation specification design, human annotation operations, calibration, inter-rater agreement, drift detection
Technologies
Python, SQL
Responsibilities
Design quality frameworks and evaluation rubrics for complex human data programs; Partner with clients and AI labs to define data requirements and strategies; Build scalable quality systems and automated checks; Architect dashboards for quality monitoring; Mentor junior analysts and upskill operations teams; Investigate data integrity issues and drive improvements.
Seniority
Founding team, hands-on IC with strategic influence