Senior Software Engineer, AI Training - Brazil
Core
Evaluate the quality of interactions with modern coding agents (e.g., OpenAI Codex, Claude Code) to assess engineering judgment and reasoning.
Role type
Senior AI Training Evaluator (Contractor)
Builds
Evaluation datasets and feedback loops for AI coding agents
Domain
Artificial Intelligence / Software Development
Deliverable
production ML models
Required skills
TypeScript/JavaScript, Python, OpenAI Codex, Claude Code, Cursor, AI-assisted dev workflows, code evaluation without execution, written English (B2+), video communication
Preferred skills
Prompt design, evaluation workflows, mentoring senior engineers, defining engineering standards
Sourced via ashby · Listed on CareerPlan, which tracks 901,000+ jobs from 20+ sources.

