AI用户体验评测专家 - 抖音电商
Core
Build and operate an AI customer service evaluation system for Douyin E-commerce to enhance intelligent customer service problem-solving capabilities and user experience across pre-sales and after-sales scenarios.
Role type
Senior AI Customer Service Evaluation Specialist
Builds
AI customer service evaluation frameworks, datasets, and quality assurance processes for Douyin E-commerce
Domain
E-commerce, AI Customer Service, Large Language Models (LLM)
Deliverable
production ML models
Required skills
LLM evaluation (LLM-as-a-Judge, Pairwise Evaluation), human-in-the-loop system design, evaluation metric definition, data analysis, team resource management, cross-functional coordination
Preferred skills
E-commerce business understanding, service strategy experience, model optimization validation
Technologies
LLM-as-a-Judge, Pairwise Evaluation
Responsibilities
Design evaluation standards and datasets for AI customer service; analyze service metrics and user feedback to identify optimization opportunities; manage annotation teams, quality calibration, and budget; coordinate with product and algorithm teams to implement improvements
Seniority
Senior, hands-on IC
