Software Engineer, AI Infra and Model Foundry
Core
Building high-performance distributed systems and infrastructure for frontier AI models, covering the full lifecycle from experimentation and training to deployment, inference, and observability.
Role type
Senior IC Software Engineer (AI Infrastructure & Model Foundry)
Builds
Scalable model serving, inference, training, and experiment platforms for Microsoft Copilot and frontier models.
Domain
Artificial Intelligence / Distributed Systems / Cloud Infrastructure
Deliverable
production ML models
Required skills
Distributed systems design, GPU/accelerator orchestration, model serving optimization, system reliability, performance engineering, cloud infrastructure, containerization, mentoring
Preferred skills
Large language model production experience, hardware-software co-design, experiment management platforms, inference techniques (batching, KV caching, quantization), high-availability operations
Technologies
C, C++, C#, Java, JavaScript, Python, Rust, Go, Kubernetes, Cloud platforms
Responsibilities
Set technical direction for scalable frontier-model infrastructure; Develop high-throughput, low-latency model-serving systems; Build reusable platform capabilities for model lifecycle management; Improve inference performance and fleet efficiency; Create reliable interfaces and developer workflows; Define SLOs and build observability systems; Diagnose and resolve bottlenecks across distributed systems; Lead response to complex production incidents; Partner with researchers on large-scale workloads; Establish technical guardrails; Mentor engineers.
Seniority
Senior, hands-on IC