DevOps Engineer - AI Model Evaluator

Madrid🌐 Remote💼 Full-time💰 $85–$85🗓 2026-08-13 → 2026-09-23

Core

Evaluate and review infrastructure engineering tasks and model-generated implementations using frontier AI coding agents.

Role type

Senior IC DevOps / SRE / Cloud Engineer (AI Model Evaluator)

Builds

Cloud platforms, Kubernetes, CI/CD systems, observability, and infrastructure automation

Domain

Cloud Infrastructure & AI Model Evaluation

Deliverable

production ML models

Required skills

DevOps, SRE, Cloud Engineering, AWS, Azure, GCP, Kubernetes, Terraform, CI/CD pipelines, observability tooling, AI coding agents (Cursor, Claude Code, Codex, Windsurf, Gemini CLI)

Preferred skills

Production-scale system support

Sourced via adzuna · Listed on CareerPlan, which tracks 924,000+ jobs from 20+ sources.

About Mercor

Series C500 Employees

Mercor's mission is to organize human intelligence to power the AI economy. We're a leading AI data company, building the layer between human expertise and frontier models. Millions of domain experts on the platform are paid over $4 million per day to train frontier AI models. Mercor's APEX benchmark family measures AI's real-world impact on professional work. Mercor Enterprise brings this same infrastructure to Fortune 500 companies: helping companies capture how their best people actually work, translating that expertise directly back into agents.