AI Model Evaluation & Quality Strategy Specialist Graduate (AI Data Service Operations) - 2027 Start
Core
Define high-quality data standards and judgment rules for large model training and evaluation, assess complex cases, and drive correction loops to improve AI model outcomes.
Role type
Graduate AI Model Evaluation & Quality Strategy Specialist
Builds
Multilingual, multimodal data assets for TikTok's global content ecosystem governance and AI/LLM training pipelines
Domain
Generative AI, Large Language Models, Content Operations
Deliverable
production ML models
Required skills
Structured thinking, abstraction, judgment, data quality assessment, root cause analysis, stakeholder alignment
Preferred skills
Experience in data quality/content review/compliance/AI data/annotation/policy, proficiency with Excel, hands-on use of large models (ChatGPT/Claude/Gemini)
Technologies
Excel, ChatGPT, Claude, Gemini
Responsibilities
Define and improve data quality standards and judgment rules for model training/evaluation; Review data outputs against standards and drive corrections; Assess complex/ambiguous cases to create reusable knowledge assets; Track quality performance and recommend workflow improvements; Collaborate with production, product, algorithm, and strategy teams to align standards
Seniority
Graduate (entry-level)
