CareerPlanSign in

Senior Manager, Software Development, AWS SageMaker HyperPod Infra

Santa Clara, California, United States💼 Full-time💰 $253,100–$342,300🗓 2026-09-09 → 2026-09-25

Core

Lead multiple software development teams to define multi-year technical strategies and deliver AI infrastructure solutions for large-scale training and inference.

Role type

Senior Manager, Software Development (Infrastructure)

Builds

Next-generation AI infrastructure systems (HyperPod) unifying training and inference across Slurm, Kubernetes, and Ray.

Domain

Cloud Infrastructure / Generative AI / High-Performance Computing

Deliverable

production ML models | infrastructure

Required skills

Multi-year technical strategy definition, engineering team leadership, cross-functional stakeholder partnership, Agile program management, large-scale system architecture design, operational health auditing, capacity management, fault-tolerant system design, GPU node management, scalability planning, maintainability assessment, resource constraint resolution, career development planning.

Preferred skills

Large-scale high-traffic application design, product and program management collaboration.

Technologies

AWS SageMaker, Slurm, Kubernetes, Ray, GPU clusters

Responsibilities

Define and own multi-year technical strategy aligning product roadmaps with engineering investments; lead, mentor, and grow software development managers and senior engineers; partner with product management to translate business problems into engineering plans; establish mechanisms to audit customer experience, operational health, and software quality; collaborate across organizational boundaries to influence technical direction and resolve prioritization conflicts.

Seniority

Senior, hands-on IC with management responsibilities

Sourced via amazon · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.