AI产品经理(评测方向) - 抖音电商
Core
Plan and build an intelligent Agent evaluation product for Douyin E-commerce to define product positioning, core scenarios, and evolution routes based on user needs and business goals.
Role type
AI Product Manager (Agent Evaluation)
Builds
Agent evaluation systems, evaluation datasets, standard management, multi-turn task execution, version comparison, and result analysis tools/platforms.
Domain
E-commerce + AI/LLM Agents
Deliverable
production ML models
Required skills
AI product management, Agent mechanism understanding, data sensitivity, experiment design, stakeholder alignment
Preferred skills
Agent evaluation experience, model behavior analysis, product metric definition
Technologies
Agent frameworks, evaluation platforms, data analysis tools
Responsibilities
Define product positioning and evolution routes for Agent evaluation; Build evaluation systems to extract evaluation directions from user feedback and model performance; Develop reusable evaluation capabilities and tooling; Collaborate with algorithm and business teams to prioritize and execute product strategies.