Technical Program Manager
Core
Own complex, time-sensitive data and evaluation programs for frontier AI labs, translating ambiguous technical asks into executable programs to improve LLM and agent evaluation.
Role type
Technical Program Manager (AI/ML Infrastructure)
Builds
Data production pipelines, evaluation frameworks, and operating rhythms for AI infrastructure
Domain
Artificial Intelligence / Machine Learning / Data Operations
Deliverable
production ML models
Required skills
Program ownership, requirements translation, data quality assessment, vendor management, workflow automation, cross-functional partnership
Preferred skills
RLHF, reinforcement-learning environments, agent evaluations, human-in-the-loop data pipelines, annotation workflows, expert data collection
Technologies
LLMs, agents, data pipelines
Responsibilities
Own data and evaluation programs end-to-end from scoping to delivery; Translate ambiguous requests into clear specifications with milestones and acceptance criteria; Maintain and improve data quality procedures using quantitative and qualitative analysis; Manage external vendors throughout the delivery lifecycle; Streamline logistics behind data production via workflow improvements; Partner with research and platform teams to translate feedback into product improvements
Seniority
Mid-level, hands-on IC
