DevOps Engineer - AI Model Evaluator
Core
Evaluate and review infrastructure engineering tasks and model-generated implementations using AI coding agents.
Role type
Senior IC DevOps/SRE/Cloud Engineer (AI Model Evaluator)
Builds
Cloud platforms, Kubernetes, CI/CD systems, observability, and infrastructure automation
Domain
Cloud Infrastructure & AI Model Evaluation
Deliverable
production ML models
Required skills
DevOps, SRE, Cloud Engineering, AWS, Azure, GCP, Kubernetes, Terraform, CI/CD pipelines, observability tooling, AI coding agents
Preferred skills
Production-scale systems support
Technologies
AWS, Azure, GCP, Kubernetes, Terraform, CI/CD, observability tools, Cursor, Claude Code, Codex, Windsurf, Gemini CLI
Responsibilities
Use AI coding agents to complete complex infrastructure engineering tasks, Review model-generated implementations for cloud platforms and automation, Identify bugs and reliability issues in model outputs, Compare outputs from multiple frontier models to assess strengths and weaknesses