Senior DGX Cloud AI Infrastructure Software Engineer
Core
Design, build, and maintain AI infrastructure software and tools for large-scale pre-training, post-training, and inference to ensure high efficiency, resiliency, and availability for AI researchers.
Role type
Senior IC AI infrastructure software engineer
Builds
Infrastructure software, tools, and libraries for NVIDIA's DGX Cloud AI platforms
Domain
AI infrastructure, High-Performance Computing, Distributed Systems
Deliverable
production ML models
Required skills
Large-scale distributed systems, AI training and inferencing infrastructure, Observability platforms (ELK, Prometheus, Loki), Root cause analysis (application to hardware), Python, C/C++, Software engineering practices (CI, testing, defensive programming)
Preferred skills
Large-scale cluster operations, Observability and telemetry stack design, RDMA software stack (NCCL, IB verbs, ucx, libfabrics), Deep Learning frameworks (PyTorch, TensorFlow, JAX, Ray)
Responsibilities
Develop infrastructure software and tools for large-scale AI workloads; Optimize tools and libraries for efficiency and resiliency; Co-design and implement APIs for resiliency stacks; Define and track reliability metrics; Triage failures from application to hardware level
Seniority
Senior, hands-on IC
