Software Development Engineer I – AI/ML Network Infrastructure, Annapurna Labs
Core
Early-career engineer building high-performance network communication libraries (NCCL, NVSHMEM, NIXL) for EC2 distributed AI/ML systems to enable training of large AI models across massive GPU clusters.
Role type
Junior IC software engineer (network infrastructure)
Builds
Network communication libraries and monitoring infrastructure for large-scale AI/ML workloads
Domain
Cloud infrastructure, High-Performance Computing (HPC), Machine Learning
Deliverable
production ML models
Required skills
C/C++, Python, Linux internals, Parallel Computer Architecture, Distributed Systems, Data structures, Algorithms
Preferred skills
CUDA, RDMA, MPI, Performance profiling, Optimization mathematics, Cloud platforms (AWS), Open-source contributions
Technologies
NCCL, NVSHMEM, NIXL, Grafana, Athena, CI/CD
Responsibilities
Write high-performance C/C++ code for network communication libraries, Build and maintain infrastructure to monitor functionality and performance of large-scale AI/ML workloads, Develop automation using Python and AWS tools to test and benchmark software, Design mechanisms to detect functional and performance regressions, Work across many instance types, software stacks, and Linux environments
Seniority
Junior, hands-on IC