CareerPlan

Senior Site Reliability Engineer

US - RemoteRemoteFull-time2026-11-04 → 2026-11-22
Remote · from United States

Core

Design, operate, and debug large-scale GPU infrastructure for distributed AI training and inference, serving model builders and research labs.

Role type

Senior Site Reliability Engineer (GPU Infrastructure)

Builds

Multi-provider, multi-region GPU compute clusters optimized for large-scale training

Domain

AI Infrastructure / High-Performance Computing

Deliverable

production ML models

Required skills

GPU cluster operations, high-performance networking (InfiniBand, RoCE, NVLink), distributed training frameworks (NCCL, PyTorch, DeepSpeed), Linux kernel internals, Kubernetes with GPU workloads, Python/Go/Bash, infrastructure automation

Preferred skills

Distributed storage systems, training performance optimization, physical cluster design, team leadership

Technologies

NVIDIA A100/H100/B200, InfiniBand, RoCE, NVLink, Kubernetes, Slurm, Terraform, Helm, Ansible, Prometheus, Grafana, DCGM, nvidia-smi

Responsibilities

Design and evolve GPU cluster architecture; serve as primary technical contact for customer workloads; define SLOs and error budgets for GPU infrastructure; ensure health of high-speed interconnects; build observability for GPU utilization and hardware health; develop automation for cluster provisioning and lifecycle management; lead incident response for complex multi-layer failures

Seniority

Senior, hands-on IC