Principal Developer, AI Networking
Core
Profile, analyze, and optimize AI workloads on large-scale GPU and CPU clusters for distributed Deep Learning LLM training and inference, with a primary focus on collectives communication and networking.
Role type
Principal Developer, AI Networking (Senior IC)
Builds
High-performance networking solutions and performance analysis tools for NVIDIA supercomputers
Domain
AI Networking, Distributed Systems, High-Performance Computing
Deliverable
production ML models | infrastructure
Required skills
High-performance networking (RDMA, MPI, NCCL, SHARP), Performance evaluation, CUDA, PyTorch, C++, Python, Bash, System architecture (CPU/GPU/HCA/Memory/PCI)
Preferred skills
AI workload benchmarking, Distributed LLM training, Hardware-software co-design
Technologies
PyTorch, CUDA, NCCL, RoCE, RDMA, MPI, SHARP, Python, C++, Bash
Responsibilities
Characterize AI workloads and deep learning models for large-scale LLM training and inference; Benchmark, profile, and analyze performance to identify bottlenecks; Develop PyTorch trace-based profiling, analysis, and replaying toolsets; Collaborate with hardware and software teams for performance insights; Define performance test plans and set expectations for new technologies.
Seniority
Principal, hands-on IC
