Human Data Engineer
Core
Design and execute high-value Human Data projects to provide engineering teams with high-quality tasks and evaluations for AI model training and assessment.
Role type
Senior IC human data engineer (LLM training & evaluation)
Builds
Data projects, evaluation strategies, and tools for measuring data effectiveness (yield, eval lift) for large language models
Domain
Artificial Intelligence / Large Language Models / Data Operations
Deliverable
production ML models
Required skills
Data analysis, dataset curation, annotation workflow design, model evaluation, Python scripting, SQL, cross-functional collaboration
Preferred skills
Master's degree, multimodal data experience, domain-specific data expertise (science, math, code), data integrity validation
Technologies
Python, SQL
Responsibilities
Partner with model teams to translate needs into data projects; own end-to-end delivery of critical data and eval projects; build tools to measure data effectiveness; maintain data integrity and truthfulness; research and implement data collection/annotation techniques; design annotation workflows and labeling interfaces; act as liaison between engineering and Human Data teams; collaborate on scaling projects and demand forecasting
Seniority
Senior, hands-on IC
