AI Evaluation & Enablement Specialist Intern (TikTok ADSO) - 2027 Start
Core
Evaluating content and AI/model performance through data annotation, analyzing evaluation data, and applying AI/automation to improve evaluation accuracy and efficiency.
Role type
Intern, AI Evaluation & Enablement Specialist
Builds
Multilingual, multimodal data assets for TikTok's global content ecosystem governance and AI/LLM training pipelines
Domain
Generative AI, Large Language Models, Content Moderation, Data Operations
Deliverable
production ML models
Required skills
Data annotation, evaluation data analysis, calibration, performance insights, training intelligence, AI experimentation, workflow optimization
Preferred skills
Undergraduate degree in law, philosophy, economics, journalism, languages, social sciences, or computer science; experience in data quality, content moderation, compliance, content operations, AI data, or annotation; familiarity with Excel and data-processing tools; experience with foundation-model products (ChatGPT, Claude, Gemini, Doubao)
Technologies
Excel, ChatGPT, Claude, Gemini, Doubao
Responsibilities
Analyze evaluation results to identify error patterns, trends, anomalies, and performance gaps; Support and maintain evaluation datasets, analytical views, and reports; Support calibration activities across evaluators and BPO teams; Identify BPO performance gaps and translate findings into targeted training and coaching initiatives; Drive continuous improvement in evaluation quality and efficiency by partnering with cross-functional teams
Seniority
Intern