Senior GPU Infrastructure Engineer
Core
Build and scale a multi-tenancy provisioning and virtualization solution for a global GPU Cloud Marketplace, transforming raw GPUs into an orchestrated pool for AI developers.
Role type
Senior Infrastructure Engineer (GPU Cloud)
Builds
GPU Cloud Marketplace orchestration layer and virtualization infrastructure
Domain
Cloud Infrastructure / AI/ML Compute
Deliverable
production ML models | infrastructure
Required skills
bare-metal provisioning, GPU scheduling and orchestration, Terraform or Pulumi, CI/CD, secrets management, observability, API design, cloud-init, GPU architecture, CUDA, distributed systems
Preferred skills
InfiniBand, RoCE, Ceph, Weka, VAST Data
Responsibilities
Design and implement multi-tenancy provisioning workflows, optimize GPU placement and memory management, integrate diverse hardware suppliers, build automated OS deployment pipelines, manage storage infrastructure for AI workloads
Seniority
Senior, hands-on IC