Senior Deep Learning Framework Communications Engineer
Core
Integrate communication libraries and AI frameworks to enable scaling Deep Learning and HPC applications across multi-GPU clusters.
Role type
Senior Deep Learning Framework Communications Engineer
Builds
AI toolkits, communication libraries (NCCL, NVSHMEM), and inference engines (TRT-LLM, vLLM, SGLang)
Domain
Artificial Intelligence, High Performance Computing, Distributed Systems
Deliverable
production ML models
Required skills
Deep Learning Frameworks (PyTorch, JAX), C++, CUDA, Python, AI Compilers, Multi-GPU Communication, Performance Profiling, Fault Tolerance
Preferred skills
Parallel Programming (NCCL, NVSHMEM, MPI), Kernel Authoring (Triton, cuTe), AI Compiler Pattern Matching, Memory Hierarchy, Compute-Communication Overlap
Technologies
PyTorch, JAX, TRT-LLM, vLLM, SGLang, NCCL, NVSHMEM, CUDA, Triton, cuTe, Python, C++, NVIDIA Nsight Systems
Responsibilities
Integrate communication library features from PoC to production; Analyze AI workloads for multi-GPU communication requirements; Improve AI compilers for communication hiding and fusion; Characterize performance on multi-GPU clusters; Design fault-tolerant and elastic solutions; Author custom communication or fused compute-communication kernels; Influence roadmap of communication libraries
Seniority
Senior, hands-on IC