办公AI效果评测产品经理 - 抖音AI
Core
Designing and executing evaluation frameworks for AI models and Agents to optimize user experience and operational efficiency on the Douyin platform.
Role type
Product Manager for AI Evaluation & Strategy
Builds
AI-native products, model training pipelines, and Agent engineering workflows for Douyin
Domain
Social Media / Generative AI / Large Language Models
Deliverable
production ML models
Required skills
Structured analysis, complex problem decomposition, data sensitivity, experimental design, academic research comprehension, strategy formulation
Preferred skills
Experience in model strategy or evaluation products, familiarity with Agent architectures and Harness systems
Technologies
LLMs, Agents, Agent Harness, evaluation frameworks
Responsibilities
Map real-world workflows of engineers and designers to build executable task evaluation datasets; Design systematic evaluation schemes to identify model and Agent capability gaps; Translate evaluation insights into concrete optimization strategies for models and products.
