Research Engineer - Language Model Pre-Training
Core
End-to-end development of language model pretraining, including large-scale training runs, performance optimization, and dataset processing.
Role type
Research Engineer - Language Model Pre-Training
Builds
Next-generation language models
Domain
Artificial Intelligence / Large Language Models
Deliverable
production ML models
Required skills
Machine learning problem solving, multi-node GPU cluster training, model/data parallelism, distributed optimizers, experimental methodology, PyTorch, Python, large-scale data processing pipelines
Preferred skills
Published machine learning research
Technologies
PyTorch, Python
Responsibilities
Implement large-scale training runs and model parallelization, optimize pretraining stack performance, collect and process datasets, conduct architecture and methodology research including optimizer ablations
Seniority
Mid-Senior, hands-on IC
