Senior DGX Cloud AI Infrastructure Software Engineer
Core
Designing, building, and maintaining AI infrastructure software and tools for large-scale pre-training, post-training, and inference to ensure high efficiency, resiliency, and availability for AI researchers.
Role type
Senior IC AI infrastructure software engineer
Builds
Infrastructure software, tools, and libraries for NVIDIA's AI platforms (DGX Cloud)
Domain
AI infrastructure, High-Performance Computing, Distributed Systems
Deliverable
production ML models
Required skills
Large-scale distributed systems, AI training/inferencing infrastructure, Observability (ELK, Prometheus, Loki), Root cause analysis (app to hardware), Python, C/C++, Software engineering practices (CI/CD, testing)
Preferred skills
Large-scale clusters, Observability/telemetry stack, RDMA (NCCL, IB verbs, ucx), DL frameworks (PyTorch, TensorFlow, JAX, Ray)
Technologies
Python, C/C++, ELK, Prometheus, Loki, NCCL, IB verbs, ucx, libfabrics, PyTorch, TensorFlow, JAX, Ray
Responsibilities
Develop infrastructure software and tools for large-scale AI workloads; Optimize tools and libraries for efficiency and resiliency; Co-design and implement APIs for resiliency stacks; Define reliability metrics; Triage failures from application to hardware level
Seniority
Senior, hands-on IC