Program Manager, Quality
Core
Designing cross-functional quality processes and managing an operational team of quality control specialists to evaluate human data deliverables for AI training and evaluation.
Role type
Senior Program Manager (Quality Operations)
Builds
Automated technical solutions for dataset evaluation and systems to monitor auditor performance.
Domain
Artificial Intelligence / Human-in-the-loop data evaluation
Deliverable
production ML models
Required skills
Cross-functional program ownership, technical solution development (LLMs, databases, scripting), team management (30+ auditors), data-driven problem solving, stakeholder communication, project management, root-cause analysis
Preferred skills
STEM background, experience with high-growth startups, experience building distributed workforces
Technologies
LLMs, databases, scripting
Responsibilities
Own quality programs for designated accounts or projects; develop technical solutions to auto-evaluate quality of datasets; devise systems to evaluate auditor and human data talent performance; report on quality through monitoring of KPIs; present leadership-facing reports on human data deliveries; help hire and maintain a 30+ auditor workforce
Seniority
Senior, hands-on IC with team leadership