CareerPlan

Software Engineer - RL Environments

San FranciscoFull-time2026-04-14 → 2026-11-19

Core

Design simulations, data, and evaluations that directly influence how frontier AI models learn and improve.

Role type

Senior IC software engineer (RL environments & data pipelines)

Builds

Simulated worlds, data pipelines, evaluation rubrics, and reward signals for RLHF/RLVR training pipelines

Domain

Artificial Intelligence / Reinforcement Learning / Foundation Models

Deliverable

production ML models

Required skills

Reinforcement learning algorithms, Docker/containerization, experiment design, quantitative framework development, data pipeline management

Preferred skills

Experience with RL environment companies, AI safety/benchmarking orgs, early-stage startup founding or engineering

Technologies

Docker, RLHF, RLVR

Responsibilities

Construct simulated worlds to expose model failure modes; Build and refine evaluation rubrics and reward signals; Analyze agent-produced trajectories; Develop quantitative frameworks for dataset quality; Create and manage real-world and synthetic data pipelines; Partner with researchers to translate training objectives into specifications

Seniority

Senior, hands-on IC