Site Reliability Engineer - Fleet Command & Control
Core
Design and run a scalable command-and-control layer for a fleet of frontier inference systems, including alerting, automated recovery, and routing to experts.
Role type
Senior Site Reliability Engineer (Fleet Operations)
Builds
Alerting standards, automated hardware health recovery workflows, and fleet telemetry pipelines.
Domain
AI Infrastructure / Supercomputing / Hardware-in-the-loop
Deliverable
production ML models
Required skills
Linux debugging, Kubernetes, Python/Golang/Rust, Prometheus/Grafana, SLO design, incident management, hardware troubleshooting (PCIe, ECC, power), distributed tracing (OpenTelemetry)
Preferred skills
GPU/HPC fleet operations, LLM inference serving, network debugging, BMC/Redfish/IPMI, data center telemetry (liquid cooling, DCIM), PagerDuty
Technologies
Linux, Kubernetes, Terraform, Ansible, Prometheus, Grafana, OpenTelemetry, Python, Golang, Rust, BMC, Redfish, IPMI
Responsibilities
Define healthy system signals and alerting standards; automate recovery actions with guardrails; route incidents to domain SREs or on-site technicians; debug production incidents across software and hardware layers; manage on-call rotations and postmortems; review service designs for failure modes.
Seniority
Senior, hands-on IC
