Research Engineer / Scientist, Pre-training
Core
Develop the next generation of large language models by conducting research and implementing solutions in model architecture, algorithms, data processing, and optimizer development.
Role type
Senior Research Engineer / Scientist (Pre-training)
Builds
Large language models, training infrastructure, and dev tooling
Domain
Artificial Intelligence / Machine Learning / Large Scale Systems
Deliverable
production ML models
Required skills
Python, PyTorch, deep learning frameworks, large-scale machine learning, transformer architectures, distributed training, ETL processes
Preferred skills
GPU optimization, Kubernetes, OS internals, reinforcement learning, high-performance ML systems
Technologies
PyTorch, Kubernetes, GPUs
Responsibilities
Design and run scientific experiments to advance understanding of large language models; Optimize and scale training infrastructure to improve efficiency and reliability; Develop and improve dev tooling to enhance team productivity; Independently lead small research projects while collaborating on larger initiatives; Contribute to the entire stack from low-level optimizations to high-level model design
Seniority
Senior, hands-on IC
