Senior Networking Solution Test Engineer – AI Cluster Debugging
Core
Designing, building, and troubleshooting large-scale AI clusters using NVLink, Ethernet, and InfiniBand to ensure high-performance networking for deep learning workloads.
Role type
Senior Networking Solution Test Engineer (AI Cluster Debugging)
Builds
Large-scale AI clusters with heterogeneous hardware, OS/driver combinations, and complex network fabrics.
Domain
AI Infrastructure / High-Performance Computing / Networking
Deliverable
production ML models | infrastructure
Required skills
Linux system-level debugging, NIC validation and tuning, AI networking libraries (NCCL), RDMA/RoCE protocols, source code analysis (C/C++/Python), scripting automation (Bash/Python/Ansible), performance benchmarking, root cause analysis.
Preferred skills
Debugging collective communication libraries, large cluster incident response, congestion control tuning (DCQCN, ECN, PFC), NVIDIA networking stack expertise, open-source networking contributions.
Technologies
NVLink, Ethernet, InfiniBand, NCCL, RoCE, RDMA, Linux, C/C++, Python, Bash, Ansible, perf, tcpdump, ethtool, iproute2, DCQCN, ECN, PFC, BlueField, ConnectX.
Responsibilities
Design and review test requirements for AI cluster portfolios; build and maintain realistic customer-like testbeds; own end-to-end cluster troubleshooting and root cause analysis; read source code to identify defects and validate fixes; collaborate with development teams to debug networking components; define tests and guide automation suite implementation; run regression, performance, functional, and scale testing; profile and benchmark deep learning workloads.
Seniority
Senior, hands-on IC