Software Engineering Intern, NCCL - 2027
Core
Design, implement, and maintain highly-optimized communication runtimes (e.g., NCCL, UCX) for Deep Learning frameworks and HPC programming interfaces on GPU clusters.
Role type
Software Engineering Intern
Builds
Communication runtimes and system software for GPU clusters
Domain
High-Performance Computing, Deep Learning, GPU Systems
Deliverable
production ML models
Required skills
C/C++ programming, Linux, parallel programming interfaces, communication runtimes, computer architecture, operating systems
Preferred skills
InfiniBand/RoCE, HPC applications, Deep Learning Frameworks (PyTorch, TensorFlow, JAX/XLA), AI/DL communication patterns (EP, TP, DP, PP), CUDA kernel optimization, large-scale model training
Technologies
NCCL, UCX, MPI, OpenSHMEM, TensorFlow, PyTorch, JAX/XLA, CUDA, InfiniBand, RoCE
Responsibilities
Design and implement communication runtimes for Deep Learning frameworks and HPC interfaces; Participate in parallel programming interface specifications; Design system software for GPU interactions; Create proof-of-concepts for programming model extensions
Seniority
Intern