CareerPlanSign in

资深AI产品经理-豆包

北京💼 Full-time🗓 2026-09-28

Core

Build and maintain evaluation systems for LLM models to assess real-world value and drive model/product optimization.

Role type

Senior AI Product Manager (LLM Evaluation)

Builds

Evaluation frameworks, benchmarks, and tool platforms for LLM applications

Domain

Artificial Intelligence / Large Language Models

Deliverable

production ML models

Required skills

LLM evaluation methodology, A/B testing analysis, data-driven problem solving, cross-functional collaboration, AI Agent technical understanding

Preferred skills

English as working language, industry trend analysis

Technologies

LLM evaluation tools, benchmarking platforms

Responsibilities

Design and iterate evaluation methodologies and standards, analyze online A/B tests and user data to identify issues, collaborate with cross-functional teams to drive optimization

Seniority

Senior, hands-on IC

Sourced via bytedance · Listed on CareerPlan, which tracks 844,000+ jobs from 20+ sources.