CareerPlan

AI Infrastructure Technical Systems Engineer

RTP, North Carolina, USFull-time$140k2026-10-23 → 2026-11-10

Core

Principal systems architect and technical authority for enterprise AI platforms, designing and operating large-scale bare-metal GPU clusters and high-performance compute infrastructure.

Role type

Senior IC AI Infrastructure Technical Systems Engineer (Principal)

Builds

Enterprise-grade supercomputing platforms, distributed AI training/inference engines, and machine learning platforms for Cisco's engineering, research, and security teams.

Domain

Enterprise IT, High-Performance Computing (HPC), AI Infrastructure

Deliverable

production ML models

Required skills

Python, Go, Bash, Kubernetes, Red Hat OpenShift, HPC workload managers (Slurm, Kueue, Volcano, Ray), RDMA/RoCEv2 networking, Linux kernel management, GPU device drivers, Infrastructure as Code (Ansible, Terraform), GitOps, SRE practices, OpenTelemetry, Prometheus, Splunk

Preferred skills

Master's degree in CS/Engineering, experience managing 500+ node server platforms, heterogeneous GPU software stacks (NVIDIA CUDA, AMD ROCm), enterprise secrets management (HashiCorp Vault), identity federation (OIDC, SAML, SSO), advanced industry certifications (CKA/CKS, RHCA/RHCE), open-source contributions

Technologies

NVIDIA BCM, Red Hat OpenShift, Ansible, Terraform, Python, Go, Slurm, Kueue, Volcano, Ray, OpenTelemetry, Prometheus, Splunk, RDMA, RoCEv2, 400G/800G networks, Redfish, IPMI, HashiCorp Vault

Responsibilities

Lead architectural design and hardware qualification for large-scale bare-metal GPU clusters; Architect resilient multi-tenant compute and control planes; Optimize distributed workload scheduling and GPU quota governance; Champion SRE automation and IaC pipelines; Profile low-level systems performance and diagnose interconnect bottlenecks; Architect end-to-end observability standards; Mentor engineering talent and author architecture blueprints.

Seniority

Senior, hands-on IC with technical leadership responsibilities