CareerPlan

Software Engineer AI Coding Tasks

RemoteFull-time$1k2026-10-17 → 2026-11-20
Remote

Core

Build AI coding tasks from known codebases to measure and train AI coding models.

Role type

Senior IC software engineer (AI model evaluation)

Builds

AI coding tasks and evaluation benchmarks

Domain

AI/ML, Software Engineering

Deliverable

production ML models

Required skills

Python, TypeScript, Go, Rust, Java, C++, Docker, Linux, Git, automated testing, AI coding tools, test writing, rubric creation

Preferred skills

Deep expertise in databases, compilers, distributed systems, security, or infrastructure, building agent tasks or RL environments

Technologies

Python, TypeScript, Go, Rust, Java, C++, Docker, Linux, Git

Responsibilities

Propose changes from a known repository, set up the repository state, write task briefs and solutions, create grading checks, stress-test with lazy/incorrect solutions, run tasks against AI models, revise tasks based on review feedback

Seniority

Senior, hands-on IC