Member of Technical Staff, Pretraining
Core
Developing large-scale pretraining systems and foundation models to enable seamless, real-time multimodal intelligence across text, audio, and vision.
Role type
Senior IC machine-learning engineer (multimodal pretraining)
Builds
Large-scale pretraining infrastructure, data pipelines, and foundation models
Domain
Artificial Intelligence / Large Language Models / Multimodal Systems
Deliverable
production ML models
Required skills
Large-scale distributed training, data curation, model architecture design, training optimization, high-performance computing systems, evaluation frameworks
Preferred skills
Multimodal pretraining (text, audio, vision)
Technologies
Megatron, DeepSpeed
Responsibilities
Drive R&D in large-scale LLM and multimodal pretraining; Develop and optimize data pipelines for pretraining; Design and implement efficient training strategies; Build and improve pretraining infrastructure; Develop evaluation frameworks and internal benchmarks; Collaborate with research and engineering teams
Seniority
Senior, hands-on IC