CareerPlan

Software Engineer, AI Infra and Model Foundry

Mountain ViewFull-time$143k–$275k2026-11-17 → 2026-11-19

Core

Building high-performance distributed systems and infrastructure for frontier AI models, covering the full lifecycle from experimentation and training to deployment, inference, and observability.

Role type

Senior IC Software Engineer (AI Infrastructure & Model Foundry)

Builds

Scalable model serving, inference, training, and experiment platforms for Microsoft Copilot and frontier models.

Domain

Artificial Intelligence / Distributed Systems / Cloud Infrastructure

Deliverable

production ML models

Required skills

Distributed systems design, GPU/accelerator orchestration, model serving optimization, system reliability, performance engineering, cloud infrastructure, containerization, mentoring

Preferred skills

Large language model production experience, hardware-software co-design, experiment management platforms, inference techniques (batching, KV caching, quantization), high-availability operations

Technologies

C, C++, C#, Java, JavaScript, Python, Rust, Go, Kubernetes, Cloud platforms

Responsibilities

Set technical direction for scalable frontier-model infrastructure; Develop high-throughput, low-latency model-serving systems; Build reusable platform capabilities for model lifecycle management; Improve inference performance and fleet efficiency; Create reliable interfaces and developer workflows; Define SLOs and build observability systems; Diagnose and resolve bottlenecks across distributed systems; Lead response to complex production incidents; Partner with researchers on large-scale workloads; Establish technical guardrails; Mentor engineers.

Seniority

Senior, hands-on IC