Software Development Engineer – AI/ML Networking Disaggregated Inference, Annapurna Labs , Elastic Collectives
Core
Building low-level data-movement software to transfer KV cache and activations across accelerators and servers over high-performance network fabrics for disaggregated LLM inference. (via careerplan.io/jobs/10567360-software-development-engineer-aiml-networking-disaggregated-inference-annapurna-labs-elast)
Role type
Senior IC systems engineer (AI/ML networking)
Builds
High-speed transfer path components for disaggregated inference pools
Domain
Cloud infrastructure, AI/ML serving, high-performance networking
Deliverable
production ML models
Required skills
C/C++, Linux, memory management, high-speed networking, HPC interconnects, GPU/accelerator systems
Preferred skills
RDMA, InfiniBand, libfabric, UCX, NCCL, MPI, embedded systems
Technologies
AWS network fabric, C/C++, Linux
Responsibilities
Build and optimize low-level data-movement software; Profile real workloads to identify bottlenecks; Work across the stack from network transport to inference frameworks; Deliver features to large-scale production clusters
Seniority
Senior, hands-on IC