大模型策略产品（J92835）
Core
Build end-to-end evaluation frameworks for LLMs across diverse application scenarios, ensuring objective and practical assessment results.
Role type
Senior LLM Strategy Product Manager (Model Evaluation)
Builds
Automated evaluation benchmark systems and product features derived from base model capabilities
Domain
Artificial Intelligence / Large Language Models
Deliverable
production ML models
Required skills
LLM evaluation methodology design, data preparation, model training and tuning, data analysis, AI tool application, product thinking
Preferred skills
Cross-functional collaboration, user requirement insight, technical adaptability
Technologies
LLM frameworks, evaluation tools, data analysis platforms
Responsibilities
Design automated evaluation benchmarks for functional and user experience dimensions; define product experience standards and data quality baselines; translate base model capabilities into product features; analyze evaluation data to guide model optimization directions
