CareerPlan

Senior Software Engineer, AI Infra Management and Ops

United States, Multiple Locations, Multiple LocationsFull-time2026-10-21 → 2026-11-10

Core

Design, develop, and maintain cloud-native services and distributed systems supporting AI infrastructure, HPC, and large-scale computing platforms.

Role type

Senior IC software engineer (AI infrastructure & distributed systems)

Builds

Platform engineering capabilities for deployment automation, service lifecycle management, observability, and reliability of AI/HPC environments.

Domain

Cloud infrastructure, High Performance Computing (HPC), AI infrastructure, Datacenter networking

Deliverable

production ML models | infrastructure

Required skills

Cloud-native architecture, Distributed systems design, Infrastructure as Code (IaC), CI/CD pipelines, Observability, Security practices, Bare-metal infrastructure management, Datacenter networking, GPU environment management, Technical leadership

Preferred skills

Knowledge of InfiniBand fabrics, RDMA, SmartNICs, DPUs, NVLink, Rack-scale systems

Technologies

Go, Rust, C#, Java, Python, C, C++, Kubernetes, Docker, Terraform, Prometheus, Grafana, InfiniBand, Ethernet, NVSwitch

Responsibilities

Design and operate AI infrastructure and HPC platforms, Collaborate on datacenter architecture and networking solutions, Guide development of platform engineering capabilities, Advance software engineering practices (CI/CD, IaC, security), Mentor engineers and foster technical excellence

Seniority

Senior, hands-on IC with architectural leadership