豆包大模型策略/评测产品经理（Coding） - 火山方舟
Core
Design and build the evaluation system for AI coding capabilities, including scenarios, datasets, metrics, and workflows to assess model performance in code generation, understanding, and debugging.
Role type
Product Manager (AI Coding Evaluation & Strategy)
Builds
Evaluation frameworks and datasets for large model coding capabilities
Domain
AI / Large Language Models / Software Engineering
Deliverable
production ML models
Required skills
Software development lifecycle expertise, system architecture design, code quality and performance optimization, structured problem analysis, data-driven metric definition
Preferred skills
Experience with complex distributed systems, technical team leadership, LLM and coding benchmark knowledge
Technologies
Large Language Models, Coding Benchmarks, Software Development Tools
Responsibilities
Identify key issues impacting AI coding experience, design evaluation scenarios and datasets, analyze model performance in engineering tasks, collaborate with algorithm and engineering teams to drive optimization.
Seniority
Senior, hands-on IC
