AI Engineer, Model Quality and Performance
Core
Own model quality and performance for Cerebras' inference offerings by defining quality metrics, building AI-driven evaluation systems, and automating release qualification pipelines.
Role type
Senior IC AI Engineer (Model Quality & Performance)
Builds
AI-driven evaluation suites, automated benchmarking workflows, and product-quality tooling for model releases.
Domain
AI Infrastructure / Custom Silicon / Model Evaluation
Deliverable
production ML models
Required skills
AI agent development, math/stats, tooling design, Docker, Git, CI/CD automation
Preferred skills
Performance tuning on custom silicon/GPUs/FPGAs, designing evals for agentic/coding/long-context/multimodal use cases, familiarity with open-source eval frameworks
Technologies
Claude, Docker, Git, CI, EvalScope, lm-eval-harness
Responsibilities
Design eval suites with AI agents in the loop; Build custom evals by orchestrating AI agents to mine trajectories; Automate eval execution end-to-end with AI-driven pipelines; Build automations to forecast and benchmark model performance; Build product-quality tooling that synthesizes quality + performance data
Seniority
Senior, hands-on IC
