Software Engineer AI Coding Tasks
Core
Build AI coding tasks from known codebases to measure and train AI coding models.
Role type
Senior IC software engineer (AI model evaluation)
Builds
AI coding tasks and evaluation benchmarks
Domain
AI/ML, Software Engineering
Deliverable
production ML models
Required skills
Python, TypeScript, Go, Rust, Java, C++, Docker, Linux, Git, automated testing, AI coding tools, test writing, rubric creation
Preferred skills
Deep expertise in databases, compilers, distributed systems, security, or infrastructure, building agent tasks or RL environments
Technologies
Python, TypeScript, Go, Rust, Java, C++, Docker, Linux, Git
Responsibilities
Propose changes from a known repository, set up the repository state, write task briefs and solutions, create grading checks, stress-test with lazy/incorrect solutions, run tasks against AI models, revise tasks based on review feedback
Seniority
Senior, hands-on IC