AI评测产品经理(库库办公方向)(J106699)
Core
Design and manage evaluation frameworks, datasets, and standards for AI agents in office productivity scenarios to ensure product capability and guide iteration.
Role type
Product Manager (AI Evaluation)
Builds
Evaluation frameworks, benchmark datasets, and scoring rubrics for AI agents
Domain
AI/LLM, Product Management, Office Productivity
Deliverable
production ML models
Required skills
AI product evaluation, benchmark construction, agent benchmark knowledge, structured thinking, written communication
Preferred skills
Office collaboration product experience, expert network management, Python scripting, data analysis, academic publications
Technologies
Python, LLMs, AI Agents
Responsibilities
Design evaluation frameworks and metrics; build and maintain benchmark datasets; manage expert networks and scoring standards; conduct competitive analysis; build evaluation pipelines with engineering teams
