Research Scientist / Engineer – Training Infrastructure
Core
Build distributed systems to train Luma's large-scale multimodal models across thousands of GPUs, enabling researchers to focus on innovation.
Role type
Senior IC distributed systems engineer (training infrastructure)
Builds
Distributed training systems for foundation models
Domain
AI/ML infrastructure, GPU clusters
Deliverable
production ML models
Required skills
distributed PyTorch training, advanced parallelization (FSDP, Tensor Parallel, Pipeline Parallel, Expert Parallel), GPU cluster optimization, NCCL, MPI, training stability, convergence optimization
Preferred skills
Linux systems administration, containerization, orchestration, cloud infrastructure, managing training runs across 100+ GPUs
Technologies
PyTorch, CUDA, NCCL, MPI
