Research Engineer, Pretraining
Core
Develop next-generation large language models at the intersection of cutting-edge research and practical engineering, focusing on safe, steerable, and trustworthy AI systems.
Role type
Research Engineer (Pretraining)
Builds
Large language models, training infrastructure, and dev tooling
Domain
Artificial Intelligence / Machine Learning
Deliverable
production ML models
Required skills
Python, deep learning frameworks (PyTorch), large-scale machine learning, model architecture design, algorithm development, data processing, optimizer development, distributed training, fault tolerance strategies
Preferred skills
High-performance large-scale ML systems, GPUs, Kubernetes, OS internals, transformer architectures, reinforcement learning, large-scale ETL processes
Technologies
PyTorch, Python, Kubernetes, GPUs
Responsibilities
Conduct research and implement solutions in model architecture, algorithms, data processing, and optimizer development; Independently lead small research projects while collaborating on larger initiatives; Design, run, and analyze scientific experiments to advance understanding of large language models; Optimize and scale training infrastructure to improve efficiency and reliability; Develop and improve dev tooling to enhance team productivity; Contribute to the entire stack from low-level optimizations to high-level model design
Seniority
Senior, hands-on IC