Senior and/or Principal Software Engineer - AI Infrastructure
Core
Design and develop core AI infrastructure services powering AzureML for large-scale AI training and inferencing using state-of-the-art LLM models.
Role type
Senior/Principal Software Engineer (AI Infrastructure)
Builds
Core compute services, training/inference infra frameworks, and machine learning systems for AzureML
Domain
Cloud AI Infrastructure, Large Language Models (LLMs), Distributed Systems
Deliverable
production ML models
Required skills
C#, Go, Rust, C++, C, C++, Java, JavaScript, Python, Kubernetes, Docker, Distributed Systems Architecture, Large Model Training Systems, Cloud Security, System Stability & Efficiency
Preferred skills
Technical leadership, Vision & Expertise, Operational Support
Technologies
AzureML, Kubernetes, Docker, C#, Go, Rust, C++, C, Java, JavaScript, Python
Responsibilities
Architect and design core compute services, Develop and maintain backend services, Operate training/inference infra frameworks, Provide technical leadership to team members, Ensure high stability and low latency
Seniority
Senior/Principal, hands-on IC with technical leadership