Senior Deep Learning Framework Communications Engineer
Core
Integrating communication libraries and optimizing multi-GPU performance for large-scale AI frameworks and inference engines.
Role type
Senior Deep Learning Framework Communications Engineer
Builds
AI toolkits, communication libraries (NCCL, NVSHMEM), and inference engines (TRT-LLM, vLLM, SGLang)
Domain
Artificial Intelligence, High Performance Computing, GPU Systems
Deliverable
production ML models | infrastructure
Required skills
Deep Learning Framework integration, C++/CUDA development, AI workload analysis, compiler technology, performance benchmarking, HPC communication concepts, kernel development
Preferred skills
Python, Triton, cuTe, PyTorch profiler, NVIDIA Nsight Systems
Technologies
PyTorch, JAX, TRT-LLM, vLLM, SGLang, NCCL, NVSHMEM, CUDA, Triton, cuTe
Responsibilities
Integrate communication library features from PoC to production, analyze AI workloads for multi-GPU requirements, collaborate on AI model teams, improve AI compilers, characterize performance on multi-GPU clusters, design fault-tolerant solutions, author custom kernels, influence communication library roadmaps
Seniority
Senior, hands-on IC
