CareerPlanSign in

Principal Software Engineer - AI Infra

USA💼 Full-time💰 $114,600–$234,600🗓 2026-09-05 → 2026-10-03

Core

Design, develop, and debug software for cloud infrastructure components (databases, applications, tools, networks) and build automation tools using AI/ML techniques to support large-scale distributed GPU workloads.

Role type

Principal Software Engineer (AI Infrastructure)

Builds

Cloud infrastructure components, automation tools, and diagnostic services for GPU platforms

Domain

Cloud Infrastructure / AI Infrastructure / GPU Computing

Deliverable

production ML models | infrastructure

Required skills

Python, Java, TypeScript, Linux, Bash, Docker, RESTful API design, Data modeling, Cloud platforms (AWS, Azure, GCP, OCI), AI/ML tooling

Preferred skills

Agile principles, API security, Kafka integration, InfiniBand/RoCE knowledge, Hardware expertise

Technologies

AWS, Azure, GCP, OCI, Docker, Kafka, InfiniBand, RoCE, OpenAPI, Swagger, Bash, Perl, Ruby, Java, Python, TypeScript, Linux, macOS

Responsibilities

Design and build software for cloud infrastructure components; Use AI/ML to create tools that automate testing and simulate environments; Lead key initiatives like spike detection and automated ticket routing; Mentor junior engineers and share technical expertise

Seniority

Principal, hands-on IC with mentorship

Sourced via devitjobs · Listed on CareerPlan, which tracks 940,000+ jobs from 20+ sources.