Pre-Training
Core
Designing and scaling large-scale AI models through algorithm development, data mixture creation, and rigorous training experiments.
Role type
Senior IC machine-learning engineer (pre-training)
Builds
Large-scale AI models and training infrastructure
Domain
Artificial Intelligence / Large-scale Distributed Systems
Deliverable
production ML models
Required skills
Large-scale distributed systems engineering, algorithm design, model architecture development, data mixture curation, experimental design, ablation studies, C/C++/Java/Python programming
Preferred skills
Conversational AI expertise, passion for learning emerging AI technologies
Technologies
C, C++, C#, Java, JavaScript, Python
Responsibilities
Develop algorithms and model architectures for large-scale training, drive algorithmic implementations and oversee flagship training runs, collaborate with infrastructure and data teams
Seniority
Senior, hands-on IC