Sr Software Development Engineer, Neuron Collectives, Annapurna Labs
Core
Optimizing collective operations and communication patterns for AWS Trainium AI training chips to scale compute across data center topologies.
Role type
Senior Software Engineer (Systems/Hardware Interface)
Builds
High-performance collective communication primitives for frontier AI model training
Domain
AI Infrastructure / High-Performance Computing / Distributed Systems
Deliverable
production ML models
Required skills
C/C++, distributed systems architecture, collective communication algorithms, hardware-software co-design, performance optimization, DMA/firmware interfacing
Preferred skills
Master's in CS, familiarity with all-reduce/all-gather, experience with distributed training frameworks
Technologies
C/C++, Neuron Explorer, Trainium silicon
Responsibilities
Enhance collective algorithms and topologies for optimal training performance, use tools to identify bottlenecks in compute and bus bandwidth, monitor and analyze processor/DMA/firmware metrics, optimize collective operations to scale AI compute, work closely with hardware teams to co-optimize software and silicon, develop C/C++ implementations of collective communication patterns, build and maintain analysis frameworks
Seniority
Senior, hands-on IC
