AI创作Agent评测策略运营（TikTok旗下图文独立端） - TikTok图文社区
Core
Design and operate evaluation systems for AI creation agents to assess model capabilities and application effects, driving optimization and improvement strategies.
Role type
AI evaluation strategy product manager
Builds
Evaluation frameworks, datasets, and tooling for AI creation agents
Domain
AI / AIGC / Large Language Models
Deliverable
production ML models
Required skills
evaluation system design, data analysis, problem localization, project coordination, strategic planning
Preferred skills
interest in LLM/AIGC, English communication
Technologies
LLM evaluation frameworks, data analysis tools
Responsibilities
Design evaluation systems for AI creation agents, analyze evaluation results to propose improvement strategies, iterate evaluation methodologies and datasets, coordinate with teams to optimize model capabilities