CareerPlan

Senior DGX Cloud AI Infrastructure Software Engineer

5 LocationsFull-time$184k–$288k2026-04-02 → 2026-11-15
Based in United States

Core

Designing, building, and maintaining AI infrastructure software and tools for large-scale pre-training, post-training, and inference to ensure high efficiency, resiliency, and availability for AI researchers.

Role type

Senior IC AI infrastructure software engineer

Builds

Infrastructure software, tools, and libraries for NVIDIA's AI platforms (DGX Cloud)

Domain

AI infrastructure, High-Performance Computing, Distributed Systems

Deliverable

production ML models

Required skills

Large-scale distributed systems, AI training/inferencing infrastructure, Observability (ELK, Prometheus, Loki), Root cause analysis (app to hardware), Python, C/C++, Software engineering practices (CI/CD, testing)

Preferred skills

Large-scale clusters, Observability/telemetry stack, RDMA (NCCL, IB verbs, ucx), DL frameworks (PyTorch, TensorFlow, JAX, Ray)

Technologies

Python, C/C++, ELK, Prometheus, Loki, NCCL, IB verbs, ucx, libfabrics, PyTorch, TensorFlow, JAX, Ray

Responsibilities

Develop infrastructure software and tools for large-scale AI workloads; Optimize tools and libraries for efficiency and resiliency; Co-design and implement APIs for resiliency stacks; Define reliability metrics; Triage failures from application to hardware level

Seniority

Senior, hands-on IC