Senior Software Engineer, CoreAI
Core
Architect, design, and develop core AI Infrastructure services to support pre-training and post-training of state-of-the-art LLMs, SLMs, multimodal, and code-specific models.
Role type
Senior IC software engineer (AI infrastructure)
Builds
Large-scale training infrastructure for LLMs, SLMs, and multimodal models on Kubernetes clusters
Domain
AI/ML infrastructure, distributed systems, cloud computing
Deliverable
production ML models | infrastructure
Required skills
Go, Rust, Python, C++, C#, distributed systems, cloud infrastructure, Kubernetes, DevOps, CI/CD, containerization, NCCL, CUDA, production ML systems (via careerplan.io/jobs/1970393556653550-senior-software-engineer-coreai-at-microsoft)
Technologies
Go, Rust, Python, C++, C#, Kubernetes, Docker, NCCL, CUDA
Responsibilities
Architect and develop core AI infrastructure services; debug and improve stability of large-scale training runs; enhance systems for high stability, low latency, and security; provide operational support and technical leadership for engineering systems.
Seniority
Senior, hands-on IC