Member of Technical Staff
Core
Build and own a self-service compute platform for training and inference workloads, managing GPU fleets across multiple cloud providers.
Role type
Senior IC infrastructure engineer (GPU compute platform)
Builds
Self-service compute platform for training and inference, multi-cluster GPU orchestration
Domain
Cloud infrastructure + GPU compute
Deliverable
infrastructure
Required skills
Kubernetes (operators, CRDs, multi-cluster), GPU cluster management, distributed systems, Go/Rust/C++, cloud orchestration
Preferred skills
vLLM, SGLang, TensorRT-LLM, Slurm, CUDA, Triton, InfiniBand, RoCE, RDMA, Prometheus, Grafana, Weights & Biases
Technologies
Kubernetes, NVIDIA, CUDA, InfiniBand, RoCE, CoreWeave, AWS, GCP, Go, Rust, C++, vLLM, SGLang, TensorRT-LLM, Slurm, Prometheus, Grafana, Weights & Biases
Responsibilities
Provision and manage GPU fleets across multiple cloud providers; Develop scheduling and placement logic for GPU capacity; Write Kubernetes operators and CRDs for multi-cluster orchestration; Build fault tolerance, autoscaling, and observability; Set technical direction and develop platform architecture and roadmap.
