Software Dev Mgr, ML Infrastructure, Edge AI Platform
Core
Build and lead the ML infrastructure team behind Amazon's Edge AI platform, enabling scientists to train, optimize, and deploy generative AI models on devices and in the cloud.
Role type
Senior IC software development manager (ML infrastructure)
Builds
Distributed training systems, GPU capacity management, CI/CD pipelines, and observability tools for large-scale generative AI models
Domain
Edge AI, Machine Learning Infrastructure, High-Performance Computing
Deliverable
production ML models (via careerplan.io/jobs/10568253-software-dev-mgr-ml-infrastructure-edge-ai-platform-at-amazon)
Required skills
Engineering team management, distributed system architecture, GPU cluster management, CI/CD pipeline design, operational reliability, stakeholder partnership
Preferred skills
Machine learning toolkit experience (PyTorch, TensorFlow, JAX), distributed ML training leadership, model compression and quantization, edge deployment strategies
Technologies
PyTorch, TensorFlow, JAX, NeMo, Megatron, MXNet, Caffe
Responsibilities
Recruit and develop software and ML infrastructure engineers; define technical roadmap for distributed training and GPU capacity; drive architecture for large-scale model parallelism; establish operational excellence and cost optimization for GPU fleets; partner with applied science and hardware teams to align requirements
Seniority
Senior, hands-on IC with people leadership