Forward Deployed Machine Learning Engineer
Core
Design and build production benchmarks and evaluation systems for foundation models across domains and modalities, including sandboxed environments for agentic evaluations.
Role type
Senior IC machine learning engineer (evaluation & infrastructure)
Builds
Production ML evaluation benchmarks, backend infrastructure (data pipelines, execution environments, storage, orchestration), and sandboxed agentic evaluation environments.
Domain
AI data infrastructure, foundation model evaluation, enterprise B2B
Deliverable
production ML models
Required skills
ML model evaluation, benchmark design, LLM-as-judge approaches, backend infrastructure, data pipelines, execution environments, storage, orchestration, customer-facing engineering
Preferred skills
LLM evaluation pipelines, foundation model lab collaboration, open-source contributions in ML evaluations, early-stage startup experience
Technologies
LLM-as-judge, data pipelines, execution environments, storage, orchestration
Responsibilities
Define and build production benchmarks with customers and researchers; own backend infrastructure systems; create sandboxed environments for agentic evaluations; manage customer engagements from scoping to delivery; identify scalable evaluation patterns.
Seniority
Senior, hands-on IC
