Principal Software Engineer- AI Frameworks
Core
Define technical vision and architecture for critical AI frameworks, performance, and developer-productivity capabilities across models, compilers, and runtimes.
Role type
Principal Software Engineer (AI Frameworks & Systems)
Builds
Scalable AI inference and training platforms, optimized frameworks, and production-grade serving systems.
Domain
Artificial Intelligence, Large Language Models (LLMs), High-Performance Computing (HPC), Distributed Systems
Deliverable
production ML models
Required skills
C++ and Python programming, GPU/accelerator programming, compiler development, low-level execution optimization, parallelism strategies (tensor, pipeline, data, expert), distributed inference acceleration, LLM serving architectures (vLLM, SGLang), cross-team technical leadership, mentoring, AI-assisted development tools
Preferred skills
Experience with Azure capacity efficiency, hardware partners alignment, establishing engineering standards
Technologies
C++, Python, vLLM, SGLang, GPU accelerators, compilers, runtimes
Responsibilities
Define multi-release strategy for AI frameworks, lead cross-stack investigations in models and compilers, drive improvements in model onboarding and runtime performance, influence architecture across teams, provide hands-on technical leadership via prototypes and code reviews, mentor junior engineers and technical leaders
Seniority
Principal, strategy & mentorship
