Sr. Model Engineer, Mid-training
Core
Scaling synthetic coding data and optimizing mid-training data mixtures for large language models to boost RL ceilings.
Role type
Senior IC machine-learning engineer (mid-training)
Builds
Mid-training checkpoints for flagship models (Grok)
Domain
Artificial Intelligence / Large Language Models
Deliverable
production ML models
Required skills
Python, PyTorch, JAX, Rust, C++, large model training (1B+ parameters), synthetic data generation, RL optimization, long-context data recipes, robust evaluation design
Preferred skills
scaling laws, ML experiment design, multi-modal data curation (text, image, audio, video), large-scale data processing frameworks, Spark, Ray
Technologies
Docker, Spark, Ray
Responsibilities
Scale synthetic coding data to trillions of tokens with large-scale docker verification, Distill flagship model intelligence into flash models via synthetic data, Optimize mid-training data mixtures for RL, Engineer long-context data recipes, Develop robust evaluation for mid-training checkpoints
Seniority
Senior, hands-on IC
