Senior Research Engineer (Code World Models)
Core
Designing and running pre-training, continued pre-training, and mid-training experiments for code-centric foundation models to improve how models understand programs and software engineering workflows.
Role type
Senior Research Engineer (Code World Models)
Builds
Production ML models for code understanding and reasoning
Domain
Software Engineering + Large Language Models
Deliverable
production ML models
Required skills
Model pre-training, continued training, mid-training, Python, modern ML frameworks, large-scale ML training workflows, data processing, distributed training, experiment tracking, debugging, data quality management, NLP, ML for software engineering
Preferred skills
Code generation, code understanding, software agents, program repair, test generation, repository-level reasoning, execution-based data (unit tests, traces, logs), large-scale distributed training of 70B+ parameter models, evaluation challenges for code models, ML infrastructure, open-source contributions
Technologies
Python, modern ML frameworks
Responsibilities
Design and run pre-training and mid-training experiments for code models; Build and improve data pipelines for large-scale model training; Develop evaluations for complex repository-level code reasoning tasks; Work with code corpora, repositories, tests, execution traces, and synthetic data
Seniority
Senior, hands-on IC