CareerPlanSign in

Principal AI System Architect

United States, Washington, Redmond💼 Full-time🗓 2026-09-14 → 2026-09-25

Core

Define AI rack- and cluster-scale architecture across accelerator, host, network, memory, storage, power, and cooling constraints while making quantitative tradeoffs between performance and TCO.

Role type

Principal AI System Architect

Builds

Large-scale AI datacenter systems and their networks

Domain

AI infrastructure / Datacenter architecture

Deliverable

production ML models | infrastructure

Required skills

Large-scale AI datacenter system design, Networking (RoCE, Infiniband, congestion control, topology), Reliability and serviceability, Hardware system architecture (machine/rack/cluster), Performance simulations and hardware modeling, Product requirements and specifications, Industry standards influence

Preferred skills

AI systems expertise, Power management expertise, Cross-functional leadership, Strategic decision-making in ambiguous environments

Technologies

RoCE, Infiniband

Responsibilities

Define AI rack- and cluster-scale architecture, Develop functional proof-of-concepts to evaluate new capabilities, Drive alignment across cross-functional engineering and leadership teams, Use performance simulations for what-if studies, Participate in industry consortiums to shape standards

Seniority

Principal, strategy & mentorship

Sourced via microsoft · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.