Senior Deep Learning Engineer, Accuracy Evaluation
Core
Design and build decision-grade evaluation environments and novel methodologies to assess the performance of frontier deep learning models (LLMs, RAG, agents, vision) and gate major model releases.
Role type
Senior IC deep learning evaluation engineer
Builds
Auditable accuracy signals, evaluation infrastructure, benchmark environments, and regression CI systems
Domain
AI/ML, Deep Learning, Model Evaluation
Deliverable
production ML models
Required skills
LLM evaluation design, statistical analysis, experimental design, evaluation infrastructure development, agentic system benchmarking, low-precision inference measurement
Preferred skills
Open-source evaluation frameworks, agentic system design (SWE-bench, GAIA), evaluation research publications, quantization-aware benchmarking, HPC/Slurm cluster management
Responsibilities
Design decision-grade evaluation environments for frontier models; Research and develop novel evaluation methodologies for emerging model families; Build and operate evaluation infrastructure and pipelines; Partner with research and product teams to translate evaluation signals into release decisions
Seniority
Senior, hands-on IC