Lead Software Engineer, ML Network Stack - Annapurna Labs
Core
Lead the design and architecture of the network stack for EC2 distributed AI/ML systems, enabling NVIDIA GPUs to work with AWS EC2 machines.
Role type
Senior IC technical lead (software engineering)
Builds
Network stack features and functions for the largest AI/ML clusters and customers
Domain
Cloud infrastructure, High-Performance Computing (HPC), AI/ML networking
Deliverable
production ML models | product features | infrastructure
Required skills
C/C++ programming, system design and architecture, full software development lifecycle, team leadership, mentoring, Linux, networking, performant coding
Preferred skills
Embedded systems, high-speed networking, HPC/RDMA interconnects, ML communication libraries, NCCL, NVSHMEM, CUDA kernels
Technologies
NCCL, NVSHMEM, NIXL, CUDA, Linux, RDMA
Responsibilities
Lead senior, mid-level, and junior SDEs; direct work to deliver functions for latest ML workloads; work across the NVIDIA ML communication stack; design and architect new and existing systems
Seniority
Senior, hands-on IC with leadership responsibilities
