Principal Software Engineer
Core
Build and operate mission-critical, hyperscale AI inferencing infrastructure powering Microsoft 365 and Dynamics 365 LLM services.
Role type
Principal Software Engineer (AI Infrastructure) (via careerplan.io/jobs/1970393556899902-principal-software-engineer-at-microsoft)
Builds
AI inferencing platform for Microsoft 365, Business & Industry Copilot, and other AI-powered products
Domain
Cloud Infrastructure / Large Language Models (LLMs)
Deliverable
production ML models | infrastructure
Required skills
Distributed systems design, Hyperscale cloud services, LLMs and AI orchestration, Event-driven architectures, High-scale storage systems, Python, C#, .NET
Preferred skills
Leading complex multi-team initiatives, Building and operating hyperscale cloud services (4+ years), Large-scale distributed systems experience
Technologies
Python, C#, .NET, LLMs, Vector databases
Responsibilities
Lead and mentor high-performing engineering teams, Drive design and delivery of the AI Inferencing platform, Own platform cost efficiency and operational excellence, Coach engineers on large-scale distributed systems, Collaborate across product and engineering teams to deliver AI solutions
Seniority
Principal, hands-on IC with strategic leadership
