CareerPlanSign in

Software Engineer II

United States, California, Mountain View💼 Full-time💰 $102,100–$102,100🗓 2026-08-19 → 2026-09-26

Core

Design, develop, and maintain AI infrastructure services for large-scale Kubernetes clusters supporting inference, pre-training, and post-training workloads for state-of-the-art AI models.

Role type

Senior IC software engineer (AI infrastructure)

Builds

Distributed systems, automation tooling, and GPU fleet operations for AI training and inference

Domain

Cloud infrastructure, AI/ML systems, distributed computing

Deliverable

production ML models | infrastructure

Required skills

Go, Rust, Python, C++, C#, Kubernetes, Docker, NCCL, CUDA, CI/CD, automated testing, distributed systems design, cloud-based infrastructure, GPU capacity optimization

Preferred skills

Experience with production ML systems, large-scale training infrastructure, technical leadership, operational support

Technologies

Go, Rust, Python, C++, C#, Kubernetes, Docker, NCCL, CUDA

Responsibilities

Design and develop AI infrastructure services; troubleshoot and optimize large-scale AI training and inference systems; build distributed systems for high reliability and low latency; develop automation for GPU capacity utilization and fleet operations; provide technical leadership and vision for engineering systems.

Seniority

Senior, hands-on IC

Sourced via microsoft · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.