Software Engineer - RL Environments
Core
Design simulations, data, and evaluations that directly influence how frontier AI models learn and improve.
Role type
Senior IC software engineer (RL environments & data pipelines)
Builds
Simulated worlds, data pipelines, evaluation rubrics, and reward signals for RLHF/RLVR training pipelines
Domain
Artificial Intelligence / Reinforcement Learning / Foundation Models
Deliverable
production ML models
Required skills
Reinforcement learning algorithms, Docker/containerization, experiment design, quantitative framework development, data pipeline management
Preferred skills
Experience with RL environment companies, AI safety/benchmarking orgs, early-stage startup founding or engineering
Technologies
Docker, RLHF, RLVR
Responsibilities
Construct simulated worlds to expose model failure modes; Build and refine evaluation rubrics and reward signals; Analyze agent-produced trajectories; Develop quantitative frameworks for dataset quality; Create and manage real-world and synthetic data pipelines; Partner with researchers to translate training objectives into specifications
Seniority
Senior, hands-on IC