Senior Software Engineer, (OpenAI Codex, Claude Code or Cursor)
Core
Evaluate the quality of interactions with modern coding agents (OpenAI Codex, Claude Code, Cursor) to assess engineering judgment and reasoning.
Role type
Senior IC AI coding agent evaluator
Builds
Evaluation datasets and feedback for AI coding tools
Domain
AI/ML + Software Engineering
Deliverable
research
Required skills
TypeScript/JavaScript or Python, OpenAI Codex/Claude Code/Cursor experience, modern AI-assisted dev workflows, code evaluation without execution, rigorous subjective judgment, written English (B2+)
Preferred skills
prompt design, evaluation workflows, mentoring senior engineers, defining engineering standards
Technologies
OpenAI Codex, Claude Code, Cursor
Responsibilities
Evaluate AI-generated coding interactions end to end, judge output usefulness and alignment with strong engineering practices, assess quality of explanations and reasoning, distinguish response quality levels, provide clear written feedback on interactions, help define standards for great AI coding interactions
Seniority
Senior, Staff or Principal-level