Technical Program Manager
Core
Own complex data and evaluation programs for AI research teams and internal partners to ensure high-quality evaluation data for improving AI systems.
Role type
Senior Technical Program Manager (AI/ML Data Operations)
Builds
High-quality evaluation datasets and data pipelines for AI research teams
Domain
Artificial Intelligence / Machine Learning / Data Operations
Deliverable
production ML models
Required skills
Technical program management, data operations, vendor coordination, data quality assessment, workflow automation, cross-functional partnership
Preferred skills
RLHF, reinforcement-learning environments, agent evaluations, human-in-the-loop data pipelines, annotation, expert data collection
Technologies
RLHF, reinforcement-learning environments, agent evaluations, human-in-the-loop data pipelines
Responsibilities
Lead data and evaluation programs from scoping through production and delivery; Turn ambiguous requests into clear specifications with milestones and acceptance criteria; Assess and improve data quality using quantitative and qualitative metrics; Manage external vendors throughout the delivery lifecycle; Improve workflows, documentation, and automation for data production; Partner with research and platform teams to turn feedback into product improvements
Seniority
Senior, hands-on IC
