Senior DGX Cloud AI Infrastructure Software Engineer
Core
Design, build, and maintain AI infrastructure enabling large-scale AI training and inferencing for researchers.
Role type
Senior IC infrastructure software engineer
Builds
Scalable AI and Data infrastructure tools and services
Domain
High-performance computing and AI infrastructure
Deliverable
production ML models
Required skills
Large-scale distributed systems, AI training and inferencing, observability platforms, Python, C/C++, root cause analysis, system reliability metrics
Preferred skills
NVIDIA GPU architecture, RDMA/IB/NCCL networking, PyTorch/TensorFlow/JAX/Ray, datacenter-scale failure analysis
Technologies
ELK, Prometheus, Loki, PyTorch, TensorFlow, JAX, Ray, RDMA, IB, NCCL
Responsibilities
Develop infrastructure software and tools for large-scale AI/LLM/GenAI; optimize tools for efficiency and resiliency; root cause and triage failures from application to hardware level; enhance infrastructure underpinning NVIDIA AI platforms; co-design and implement APIs for resiliency stacks; define reliability metrics to track and improve system/service reliability
Seniority
Senior, hands-on IC