CareerPlan

大模型产品实经理(J107028)

北京市Full-time2026-11-03 → 2026-11-10

Core

Define capability goals and iteration plans for a Coding LLM, design audit rules for complex coding tasks, and build automated evaluation systems to drive model improvements.

Role type

Senior Product Manager (Large Language Models - Coding)

Builds

Coding LLM products and evaluation infrastructure

Domain

Artificial Intelligence / Software Engineering

Deliverable

production ML models

Required skills

Coding LLM iteration planning, complex task audit rule design, automated evaluation system construction, data analysis, cross-functional collaboration

Preferred skills

Software engineering background, understanding of Coding Agent mechanisms (context, tool use, sandbox execution), ability to analyze model vs tool vs evaluation issues

Technologies

LLM-as-judge, unit testing, static analysis, sandbox execution

Responsibilities

Drive model iteration cycles and capability diagnostics, design audit rules for correctness and safety of code generation, build and maintain automated evaluation pipelines, establish testing standards and scoring rubrics, collaborate with algorithm and data teams to translate evaluation results into product improvements