LLM Evaluation Product Operations Specialist – TikTok
Core
Design and operationalize the evaluation framework for TikTok's in-app AI chatbot (Tako), bridging user insights and data analysis to drive product improvement.
Role type
Product Operations Specialist (LLM Evaluation)
Builds
Evaluation framework for AI chatbot experience
Domain
Consumer social media / Large Language Models
Deliverable
production ML models
Required skills
Data analysis, User research, Scenario definition, Quality standard definition, Cross-functional collaboration, Project execution, Logical thinking, Detail orientation
Preferred skills
LLM evaluation experience, User-facing product experience
Sourced via tiktok · Listed on CareerPlan, which tracks 845,000+ jobs from 20+ sources.
