Senior Research Engineer (Code World Models) (m/f/d)
Core
Design and run pre-training, continued pre-training, and mid-training experiments for code-centric foundation models to improve how models understand programs, repositories, and software engineering workflows.
Role type
Senior Research Engineer (Code World Models)
Builds
Code models for understanding programs, repositories, execution, tests, and software engineering workflows
Domain
Software Engineering + Large Language Models
Deliverable
production ML models
Required skills
model pre-training, continued training, mid-training, Python, modern ML frameworks, large-scale ML training workflows, data processing, distributed training, experiment tracking, debugging, large dataset management, NLP, ML for software engineering
Preferred skills
code generation, code understanding, software agents, program repair, test generation, repository-level reasoning, execution-based data, large-scale distributed training (70B+ parameters), evaluation challenges for code models, ML infrastructure, open-source contributions
Technologies
Python, modern ML frameworks
Responsibilities
Design and run pre-training, continued pre-training, and mid-training experiments; Build and improve data pipelines for large-scale model training; Work with code corpora, repositories, tests, execution traces, and synthetic data; Develop evaluations for complex repository-level code reasoning tasks; Collaborate with researchers and engineers working on ML for code and AI developer tools
Seniority
Senior, hands-on IC
