Technical Program Manager
Core
Own complex, time-sensitive data and evaluation programs for frontier AI labs, data vendors, and internal teams to ensure data is useful for evaluating and improving LLMs and agents.
Role type
Technical Program Manager (AI/ML data operations)
Builds
RL training data, evaluation datasets, and marketplaces for frontier AI agents
Domain
Artificial Intelligence / Machine Learning / Data Operations
Deliverable
production ML models | product features
Required skills
Program ownership, requirements translation, data quality judgment, vendor management, process improvement, cross-functional partnership
Preferred skills
RLHF, reinforcement-learning environments, agent evaluations, human-in-the-loop pipelines, annotation, expert data collection, early-stage startup experience
Technologies
RLHF, reinforcement-learning environments, agent evaluations, human-in-the-loop data pipelines
Responsibilities
Own data and evaluation programs end-to-end from scoping to delivery; Translate ambiguous requests into clear specifications with milestones and acceptance criteria; Maintain and improve data quality procedures using quantitative and qualitative signals; Manage external vendors throughout the delivery lifecycle; Streamline logistics by improving workflows, documentation, and automation; Partner with research and platform teams to translate feedback into product improvements
Seniority
Individual Contributor, mid-to-senior level
