Capacity & Efficiency Infrastructure
Core
Design, implement, test, and optimize distributed training infrastructure for large-scale GPU clusters to improve compute fleet efficiency and manage capacity.
Role type
Senior IC infrastructure engineer (distributed training & HPC)
Builds
Telemetry systems, optimization tools, and distributed training infrastructure for frontier-scale AI models.
Domain
AI Infrastructure / High-Performance Computing / Generative AI
Deliverable
production ML models
Required skills
Distributed training, GPU architecture, Performance profiling, C++, Python, CUDA, NCCL, InfiniBand, NVLink, PyTorch, JAX, System debugging
Preferred skills
Large-scale ML infrastructure, GenAI model optimization, Networking, Storage systems, Technical leadership
Technologies
Python, C++, CUDA, NCCL, PyTorch, JAX, InfiniBand, NVLink, NVIDIA, MAIA
Responsibilities
Design and optimize distributed training infrastructure for large-scale GPU clusters; Build and evolve telemetry systems for infrastructure and ML model performance; Profile, benchmark, and debug performance bottlenecks across compute, memory, networking, and storage; Drive architectural improvements for ML services to deliver efficiency gains; Optimize collective communication libraries for emerging topologies; Partner with researchers and hardware teams to balance growth with efficiency.
Seniority
Senior, hands-on IC