Content Quality and Evaluation Specialist Graduate (Indonesian - SMO) - 2027 Start
Core
Design and iterate data quality standards and judgment rules for LLM training and evaluation data; review and adjudicate data outputs to ensure accuracy and consistency for TikTok's global content ecosystem and AI models.
Role type
Content Quality and Evaluation Specialist (Graduate)
Builds
Multilingual, multimodal data assets for AI training and evaluation pipelines
Domain
Generative AI, Large Language Models, Content Governance
Deliverable
production ML models
Required skills
Data quality standards design, data adjudication, edge case analysis, quality metrics tracking, cross-functional collaboration, complex guideline interpretation, structured problem decomposition, logical thinking, detail-oriented analysis
Preferred skills
Content policy development, operational guideline enforcement, machine-executable logic familiarity, labeling frameworks knowledge, dataset validation, scenario coverage management, positive/negative balance understanding
Technologies
Excel, mainstream LLM products (ChatGPT, Claude, Gemini)
Responsibilities
Design and iterate data quality standards and judgment rules for LLM training; Review and adjudicate data outputs against quality standards; Analyze complex, ambiguous, and edge cases to create reusable judgment rules; Track quality metrics and drive process improvements; Partner with production, product, algorithm, and policy teams to align on quality standards
Seniority
Graduate, entry-level IC