DevOps Engineer - AI Model Evaluator
Core
Evaluate and review AI-generated infrastructure engineering solutions for cloud platforms, Kubernetes, and CI/CD systems to identify bugs and reliability issues.
Role type
Senior IC DevOps/SRE (AI Model Evaluator)
Builds
Production-grade cloud infrastructure and automation pipelines
Domain
Cloud Infrastructure + AI Model Evaluation
Deliverable
production ML models | infrastructure
Required skills
DevOps, SRE, Cloud Engineering, AWS, Azure, GCP, Kubernetes, Terraform, CI/CD pipelines, observability tooling, AI coding agents (Cursor, Claude Code, Codex, Windsurf, Gemini CLI)
Preferred skills
Production-scale system support
Technologies
AWS, Azure, GCP, Kubernetes, Terraform, CI/CD pipelines, observability tooling, Cursor, Claude Code, Codex, Windsurf, Gemini CLI
Responsibilities
Use frontier AI coding agents to complete complex infrastructure engineering tasks; Review model-generated implementations for cloud platforms, Kubernetes, CI/CD systems, observability, and infrastructure automation; Identify bugs, edge cases, reliability issues, and failure modes; Compare outputs from multiple frontier models and assess their strengths and weaknesses; Apply professional engineering judgment to realistic infrastructure engineering scenarios; Work independently and asynchronously to meet sprint-based project deadlines.