评测运营（AI方向）-广告业务（北京/上海）
Core
Design and maintain evaluation systems for commercial AI advertising products, translating client feedback into evaluation tasks to drive model optimization.
Role type
AI Product Evaluation Engineer (Advertising)
Builds
Quantitative analysis reports and evaluation frameworks for AI advertising models
Domain
Advertising technology + Large Language Models (LLM)
Deliverable
production ML models
Required skills
LLM evaluation, benchmark design, statistical analysis, model comparison, requirement translation, industry workflow analysis
Preferred skills
Agent/Vibe Coding tools, To B client management, mainstream LLM team experience
Technologies
Eval toolchains, Agent tools, Vibe Coding tools
Responsibilities
Define evaluation dimensions, metrics, and standards for AI ad products; Convert client feedback into specific evaluation tasks; Conduct model comparison analysis to guide optimization; Design industry-specific evaluation schemes; Track and upgrade evaluation methodologies.
