Software Development Engineer, SageMaker HyperPod Data Plane
Core
Design, develop, test, and deploy distributed machine learning systems and large-scale solutions for training deep learning workloads and LLMs in the cloud.
Role type
Senior IC software development engineer (distributed systems/LLM training)
Builds
Next-generation AI compute platform optimized for LLMs and distributed training
Domain
Cloud computing, Deep Learning, Large Language Models
Deliverable
production ML models
Required skills
C++, Go, Kubernetes, High Performance Computing, Large Language Model training, System architecture, Distributed systems
Preferred skills
Resource orchestrators, Scalable systems, Multi-threaded asynchronous development
Technologies
Kubernetes, PyTorch, NVIDIA/GPU
Responsibilities
Develop innovative solutions for supporting Large Language Model training in a cluster of nodes; Optimize distributed training by profiling and improving compute/network performance; Serve as a key technical resource in the full development cycle; Own delivery of entire piece of the system and serve as technical lead on complex projects; Hire/mentor junior development engineers
Seniority
Senior, hands-on IC