Senior Deep Learning Framework Communications Engineer
Core
Integrate communication libraries and optimize multi-GPU communication for AI frameworks like PyTorch, TRT-LLM, and vLLM to support scaling from microsecond latency inference to 100K GPU training clusters.
Role type
Senior Deep Learning Framework Communications Engineer
Builds
AI toolkits, communication libraries (NCCL, NVSHMEM), and optimized kernels for NVIDIA platforms
Domain
High Performance Computing (HPC) and Artificial Intelligence
Deliverable
production ML models
Required skills
Deep Learning Frameworks (PyTorch, JAX, TRT-LLM, vLLM, SGLang), C++, CUDA, Python, AI compilers, multi-GPU communication, performance benchmarking, fault-tolerant system design
Preferred skills
Parallel programming (NCCL, NVSHMEM, MPI), kernel authoring (Triton, cuTe), AI compiler pattern matching, memory hierarchy understanding, compute-communication overlap
Technologies
PyTorch, JAX, TRT-LLM, vLLM, SGLang, NCCL, NVSHMEM, CUDA, Triton, cuTe, Python, C++, NVIDIA Nsight Systems
Responsibilities
Integrate communication library features from PoC to production, analyze AI workloads for multi-GPU requirements, improve AI compilers for communication hiding/fusion, characterize performance on multi-GPU clusters, design fault-tolerant elastic solutions, author custom communication kernels, influence communication library roadmaps
Seniority
Senior, hands-on IC
