Sr. Software Engineer- AI/ML, AWS Neuron Distributed Training
Core
Senior Machine Learning Engineer leading the development, enablement, and performance tuning of distributed training solutions for AWS Neuron (Trainium/Inferentia) accelerators, focusing on massive-scale LLMs and other model families.
Role type
Senior IC machine learning engineer (distributed training)
Builds
Distributed training support for PyTorch and JAX using XLA and Neuron compiler stacks
Domain
Cloud infrastructure / Machine Learning / Custom Silicon
Deliverable
production ML models
Required skills
Distributed training libraries (FSDP, Deepspeed, Nemo), Python, PyTorch, JAX, XLA, Neuron compiler, model optimization, cross-functional collaboration
Preferred skills
Computer architecture, TensorFlow, end-to-end model training
Technologies
AWS Trainium, AWS Inferentia, PyTorch, JAX, XLA, FSDP, Deepspeed, Nemo
Responsibilities
Lead efforts to build distributed training support into PyTorch and JAX; optimize models for peak performance on AWS custom silicon; work with chip architects and compiler engineers to tune distributed training solutions
Seniority
Senior, hands-on IC