Human Data Manager
Core
Design and execute high-value human data projects to provide engineering teams with high-quality tasks and evaluations for AI model training and alignment.
Role type
Senior Human Data Manager (AI/ML)
Builds
High-quality training and evaluation datasets for large language models and AI systems
Domain
Artificial Intelligence / Machine Learning / Data Operations
Deliverable
production ML models
Required skills
Data analysis, dataset curation, evaluation strategy design, data integrity validation, cross-functional collaboration, project management, SQL, Python scripting, AI agent usage, multimodal data handling
Preferred skills
STEM degree, experience with LLM training/evaluation, annotation workflow optimization, domain-specific data (science/math/code), model evaluation for truthfulness/alignment
Technologies
SQL, Python, AI agents, no/low-code tools
Responsibilities
Partner with model teams to translate needs into data projects; own end-to-end delivery of critical data projects; measure data effectiveness using AI agents; maintain data integrity and factual accuracy; research data collection and multi-modal integration techniques; shape model behavior through data management; act as liaison between engineering and human data teams; collaborate on scaling projects and demand forecasting.
Seniority
Senior, hands-on IC
