Senior DGX Cloud AI Infrastructure Software Engineer
Core
Design, build, and maintain AI infrastructure enabling large-scale AI training and inferencing for researchers.
Role type
Senior IC AI infrastructure software engineer
Builds
Infrastructure software and tools for large-scale AI, LLM, and GenAI platforms
Domain
AI infrastructure, High-Performance Computing, GPU clusters
Deliverable
production ML models
Required skills
Large-scale distributed systems, debugging (app to hardware), observability platforms (ELK, Prometheus, Loki), Python, C/C++, system reliability metrics
Preferred skills
NVIDIA GPU cluster experience, RDMA/IB/NCCL, DL frameworks (PyTorch, TensorFlow, JAX, Ray), datacenter-scale failure analysis
Technologies
Python, C/C++, ELK, Prometheus, Loki, PyTorch, TensorFlow, JAX, Ray, RDMA, IB, NCCL
Responsibilities
Develop infrastructure software and tools for large-scale AI systems; Optimize tools for efficiency and resiliency; Root cause and analyze failures from application to hardware level; Enhance infrastructure underpinning NVIDIA's AI platforms; Co-design and implement APIs for resiliency stacks; Define reliability metrics to track and improve system/service reliability
Seniority
Senior, hands-on IC