CareerPlanSign in

Software Co-Design AI HPC Systems

United States, Multiple Locations, Multiple Locations💼 Full-time🗓 2026-02-12 → 2026-09-25

Core

Lead the co-design of AI systems across hardware and software boundaries, optimizing parallelism strategies and distributed algorithms for large-scale AI training and inference.

Role type

Senior IC systems engineer (AI hardware/software co-design)

Builds

High-performance AI clusters, accelerators, and distributed training/inference frameworks

Domain

AI infrastructure, high-performance computing, hardware-software co-design

Deliverable

production ML models

Required skills

Performance modeling, benchmarking, systems analysis, C/C++/Python programming, large-scale cluster design, accelerator interconnects, communication stacks (NCCL, MPI, RDMA, InfiniBand)

Preferred skills

Custom kernel development, memory optimization, system integration trade-offs

Technologies

NCCL, MPI, RDMA, InfiniBand, C, C++, Python

Responsibilities

Analyze real workloads to identify bottlenecks across compute, communication, and data movement; Develop and evaluate what-if performance models to project system behavior; Partner with compiler and runtime teams to unlock accelerator performance; Mentor senior engineers and set technical direction for co-design initiatives

Seniority

Senior, hands-on IC with mentorship responsibilities

Sourced via microsoft · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.