AI Infrastructure Operations Engineer
Core
Design, build, and operate large-scale GPU and accelerated-computing infrastructure for AI training, inference, simulation, and high-performance compute workloads across cloud, on-premises, and hybrid environments.
Role type
Senior IC AI Infrastructure Operations Engineer
Builds
Resilient, high-performance compute environments and reusable operational tools/automation workflows for AI and HPC workloads
Domain
AI Infrastructure / High-Performance Computing / Cloud & On-Premises
Deliverable
production ML models
Required skills
GPU cluster management, Kubernetes orchestration, infrastructure automation (Terraform, Ansible), Python/Bash scripting, workload scheduling (Slurm, Run:ai), capacity planning, performance benchmarking, incident management
Preferred skills
AgenticOps practices, REST API/OpenAPI integration, NVIDIA platform tools (Base Command Manager, NGC, NCCL, CUDA-X), managing 1,000+ GPU clusters, LLM deployment on AI Cloud platforms
Technologies
Kubernetes, Slurm, Run:ai, Terraform, Ansible, Python, Bash, NVIDIA Base Command Manager, NGC, NCCL, CUDA-X
Responsibilities
Design and implement accelerated-computing infrastructure solutions; Deploy and operate GPU-based clusters; Integrate infrastructure with enterprise systems and security frameworks; Build automation workflows for provisioning and monitoring; Establish repeatable operational processes for lifecycle management; Perform benchmarking and diagnose performance issues; Provide technical guidance and optimization for GPU clusters
Seniority
Senior, hands-on IC
