Content Quality and Evaluation Graduate (AI Data Service Operations) - 2027 Start
Core
Design and enforce data quality standards for LLM training and evaluation data to ensure model performance and ecosystem governance.
Role type
Junior IC content quality and evaluation specialist (AI data operations)
Builds
High-quality, multilingual, multimodal training and evaluation datasets for global AI models
Domain
Generative AI / Large Language Models / Content Governance
Deliverable
production ML models
Required skills
Data quality standards definition, judgment criteria unification, root-cause analysis, cross-functional collaboration, policy interpretation, qualitative content evaluation
Preferred skills
LLM product familiarity, machine-executable logic, dataset validation, scenario coverage management
Technologies
Excel, mainstream LLM products (ChatGPT, Claude, Gemini)
Responsibilities
Design and iterate data quality standards and judgment rules; Review and adjudicate data outputs against standards; Analyze edge cases to create reusable knowledge assets; Track quality metrics and drive process improvements; Partner with production, product, and algorithm teams to align on quality loops
Seniority
Graduate / Entry-level, hands-on IC
