Member of Technical Staff - Evaluation Infrastructure
Core
Build highly reliable, efficient, and easy to use infrastructure that runs all evaluations at scale for next-generation AI models.
Role type
Senior IC infrastructure engineer (evaluation systems)
Builds
Evaluation infrastructure stack for training and assessing large language models
Domain
AI/ML infrastructure, distributed systems, GPU compute
Deliverable
production ML models
Required skills
large-scale distributed systems, debugging, performance optimization, inference, GPU compute management, workload scheduling, dynamic resource optimization, model comparison interfaces
Preferred skills
LLM inference, GPU compute management, workload scheduling, dynamic resource optimization, model comparison interfaces
Technologies
GPU, distributed systems, inference engines
Responsibilities
Build reliable evaluation infrastructure, collaborate on developing new evals and maintaining signal quality, resolve performance bottlenecks in inference and orchestration layers
Seniority
Senior, hands-on IC
