CareerPlanSign in

Human Data Quality Engineer (Founding Team)

Prolific - Hybrid US🌐 Remote💼 Full-time🗓 2026-07-21 → 2026-09-26

Core

Designing quality frameworks and building scalable systems to ensure high-quality human data for training advanced AI models.

Role type

Founding team Human Data Quality Engineer (AI/ML)

Builds

Quality infrastructure, evaluation rubrics, automated checks, and dashboards for human data programs.

Domain

Artificial Intelligence / Machine Learning / Human Data Operations

Deliverable

production ML models

Required skills

Python, SQL, machine learning pipelines, statistical thinking, data analysis, system architecture, stakeholder management, ambiguity navigation

Preferred skills

LLM evaluation, RLHF, AI safety, red teaming, annotation specification design, human annotation operations, calibration, inter-rater agreement, drift detection

Technologies

Python, SQL

Responsibilities

Design quality frameworks and evaluation rubrics for complex human data programs; Partner with clients and AI labs to define data requirements and strategies; Build scalable quality systems and automated checks; Architect dashboards for quality monitoring; Mentor junior analysts and upskill operations teams; Investigate data integrity issues and drive improvements.

Seniority

Founding team, hands-on IC with strategic influence

Sourced via greenhouse · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.