Machine Learning Engineer
Core
Build and scale core infrastructure for real-world AI model evaluation, including data pipelines, inference APIs, and evaluation methodologies.
Role type
Senior Machine Learning Engineer (AI Evaluation Infrastructure)
Builds
Data pipelines, model training systems, and evaluation APIs for AI benchmarking
Domain
Artificial Intelligence / Machine Learning / Evaluation Systems
Deliverable
production ML models
Required skills
Deep learning, language models, reward model training, LLM fine-tuning, prompt engineering, function calling, anti-abuse systems, statistics, uncertainty evaluation
Preferred skills
Full-stack development, rapid product iteration, research into state-of-the-art evaluation methods
Technologies
LLM stacks, data pipelines, inference APIs
Responsibilities
Architect core modeling for data and evaluation products; Own full-stack data, model training, and eval pipelines; Conduct research into evaluation methods; Partner with researchers and product leadership to build reliable systems
Seniority
Senior, hands-on IC