AI评测产品经理-广告业务
Core
Design and implement evaluation systems for search advertising scenarios to define ideal states, assessment standards, and methods combining human and automated evaluation to reflect user value and commercial efficiency.
Role type
Product Manager for AI Evaluation (Search Advertising)
Builds
Automated evaluation pipelines, sampling mechanisms, trace diagnostics, and monitoring dashboards on experiment and data platforms.
Domain
Internet / Search Advertising / Large Language Models (LLM) / Recommendation Systems
Deliverable
production ML models
Required skills
Evaluation system design, dataset construction, quality assurance, cross-functional collaboration, problem diagnosis, strategy iteration
Preferred skills
Experience building evaluation systems from 0 to 1, independent analysis, complex project management
Technologies
Experiment platforms, data platforms, automated evaluation tools, trace analysis tools
Responsibilities
Define ideal states and assessment standards for search ad scenarios; Build and maintain evaluation datasets and question banks; Engineer evaluation tools for efficiency; Diagnose model and strategy issues based on evaluation results to drive optimization.
