Principal Software Engineer, E2E Performance and Goodput — CSP Engagements
Core
Principal Engineer acting as technical focal point for end-to-end performance and goodput for key CSP/hyperscale customers on NVIDIA platforms.
Role type
Principal Software Engineer (Systems Performance)
Builds
Shared understanding of platform performance characteristics, optimization priorities, and validation tooling for CSP workloads.
Domain
High-Performance Computing (HPC) / AI Infrastructure / GPU Systems
Deliverable
production ML models
Required skills
GPU workload profiling, distributed training performance dynamics, statistical methods for performance analysis, full software stack impact analysis, data analysis and visualization, cross-team influence
Preferred skills
Profiling and optimizing distributed training at 1000+ GPU scale, ML infrastructure performance at CSP/hyperscaler, NVIDIA platforms familiarity, automated performance regression detection systems, inference workload performance dynamics
Technologies
NVIDIA CUDA, NCCL, DCGM, nsight systems, nsight compute, Megatron-LM, DeepSpeed, FSDP, vLLM, TensorRT-LLM, SGLang, Python, pandas
Responsibilities
Drive performance characterization work streams with CSP engineering teams, gather and synthesize CSP performance feedback, ensure open-source performance tools are updated and validated, conduct cross-CSP performance comparison and pattern analysis, collaborate on performance-related integration work, define test strategies and tooling requirements for performance validation
Seniority
Principal, hands-on IC with strategy & mentorship
