Senior Technical Program Manager
Core
Own complex data and evaluation programs for AI research teams and internal partners to improve LLM and agent evaluations.
Role type
Senior Technical Program Manager (AI/ML Data Operations)
Builds
Reliable processes, data production pipelines, and evaluation frameworks for LLMs and agents
Domain
Artificial Intelligence / Machine Learning / Data Infrastructure
Deliverable
production ML models
Required skills
Program ownership, requirements gathering, data quality assessment, vendor management, workflow automation, cross-functional collaboration (via careerplan.io/jobs/f19ecfdb-2416-4b4c-b8c1-9b84de85fb6f-senior-technical-program-manager-at-clera)
Preferred skills
RLHF, reinforcement-learning environments, agent evaluations, human-in-the-loop data pipelines, annotation, expert data collection
Technologies
LLMs, agents, data pipelines
Responsibilities
Lead data and evaluation programs from scoping to production; Turn evolving technical requests into clear specifications; Assess and improve data quality using quantitative and qualitative metrics; Manage external vendors across the delivery lifecycle; Improve workflows, documentation, and automation; Work with research and platform teams to turn operational learnings into product improvements
Seniority
Senior, hands-on IC