Senior Hardware Diagnostics Engineer - Infrastructure
Core
Own the firmware lifecycle and validation infrastructure for large-scale AI compute clusters, ensuring safe rollout of BIOS, BMC, and device firmware across GPU-intensive data centers.
Role type
Senior Hardware Diagnostics Engineer (Infrastructure)
Builds
Automated firmware validation harnesses, fleet-scale rollout tooling, and root cause analysis frameworks for hardware/firmware failures.
Domain
AI Infrastructure / Data Center Hardware / Firmware Engineering
Deliverable
production ML models
Required skills
Firmware lifecycle management, BMC/Redfish/IPMI automation, Linux systems debugging, Python scripting, PCIe error analysis, thermal/power telemetry forensics, vendor escalation, technical writing.
Preferred skills
AMD GPU/ROCm experience, HPC validation (RCCL/NCCL), low-level bus work (I2C/SMBus), kernel crash dump analysis, Ansible, DCIM/IPAM tooling.
Technologies
Redfish, IPMI, iDRAC, iLO, Python, Linux, ROCm, RCCL, NCCL, Ansible, NetBox.
Responsibilities
Qualify and roll out firmware versions across the fleet; design validation harnesses for regression and performance testing; automate firmware management via APIs; define burn-in test matrices and thresholds; lead root cause analysis on unreproducible hardware failures; escalate firmware defects to OEMs/ODMs; prepare validation for next-gen hardware platforms.
Seniority
Senior, hands-on IC with mentorship responsibilities.