CareerPlanSign in

Principal Software Engineer

United States, Multiple Locations, Multiple Locations💼 Full-time🗓 2026-09-09 → 2026-09-25

Core

Define technical direction for cloud infrastructure and machine learning platforms, designing distributed systems for model training, inference, and data processing.

Role type

Principal Software Engineer (ML Infrastructure & Platform)

Builds

Cloud infrastructure, ML platforms, distributed systems, and MLOps frameworks.

Domain

Cloud computing, Machine Learning, Artificial Intelligence, Distributed Systems

Deliverable

production ML models | infrastructure

Required skills

Kubernetes, container orchestration, cloud platforms, networking, storage systems, site reliability engineering, large-scale distributed systems, machine learning platform design, GPU infrastructure, distributed batch scheduling, MLOps frameworks, KubeRay, Kueue, large language model ecosystems, foundation model training and inference, model serving, observability, enterprise AI infrastructure scaling, architecture leadership, technical strategy.

Preferred skills

Go, C, C++, C#, Java, JavaScript, Python

Technologies

Kubernetes, KubeRay, Kueue

Responsibilities

Define technical direction for cloud infrastructure and ML platforms; Design and review distributed systems for model training and inference; Align architecture, reliability, security, and scalability with partner teams; Improve platform efficiency in compute utilization and resource management; Support MLOps practices for model lifecycle management; Provide technical guidance for AI workloads in production; Contribute to long-term platform planning and engineering best practices.

Seniority

Principal, strategy & mentorship

Sourced via microsoft · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.