Agent数据&评测工程师/专家-Dev Infra
Core
Design and build automated evaluation infrastructure for LLM-based Agents in coding and personal assistant scenarios, including developing evaluation agents, creating benchmarks, and optimizing model capabilities.
Role type
Senior IC LLM Agent Evaluation Engineer (Dev Infra)
Builds
Automated evaluation infrastructure, evaluation agents, and high-quality datasets for Agent benchmarking
Domain
Artificial Intelligence / Large Language Models / Software Engineering
Deliverable
production ML models
Required skills
C/C++/Go/Python, data structures and algorithms, LLM application development, automated evaluation system design, data synthesis and parsing, benchmark creation
Preferred skills
Agent development experience, academic publications, industry trend analysis
Technologies
LLM frameworks, data processing pipelines, evaluation frameworks
