Technical Program Manager
Core
Own complex, time-sensitive data and evaluation programs for AI research teams and internal partners to improve LLM and agent evaluation.
Role type
Technical Program Manager (AI/ML Data Operations)
Builds
Reliable data and evaluation programs, scalable delivery pipelines, and improved data quality processes.
Domain
Artificial Intelligence / Machine Learning / Data Operations
Deliverable
production ML models
Required skills
Program management, requirements gathering, data quality analysis, vendor management, workflow automation, cross-functional partnership, quantitative judgment, qualitative review
Preferred skills
RLHF, reinforcement-learning environments, agent evaluations, human-in-the-loop data pipelines, annotation workflows, expert data collection
Responsibilities
Lead data and evaluation programs from scoping through production and delivery; Turn ambiguous technical requests into clear specifications with milestones and acceptance criteria; Improve data quality processes using quantitative and qualitative measures; Manage external vendors through the delivery lifecycle; Improve workflows, documentation, and automation for data production; Partner with research and platform teams to turn findings into product improvements
Seniority
Mid-level (3+ years experience)
