豆包AI大模型产品经理(评测方向)-火山方舟MaaS
Core
Design the top-level architecture for the To B evaluation system of the Doubao AI large model, defining dimensions, metrics, standards, and processes to ensure evaluation results reflect customer usage effects.
Role type
Product Manager (Large Model Evaluation)
Builds
Quantitative analysis conclusions and root-cause breakdowns to drive model optimization; industry-specific evaluation schemes.
Domain
Artificial Intelligence / Large Language Models / To B Enterprise Services
Deliverable
production ML models
Required skills
Large model evaluation methodology, benchmark design, statistical methods, industry business process analysis, quantitative analysis, cross-team communication
Preferred skills
Experience with mainstream LLM teams, vertical industry AI applications (finance, healthcare, law), AI tool usage (Agents, Vibe coding), To B customer interface experience
Technologies
Eval toolchains, Agent tools, Vibe coding tools