Senior Software Engineer - Performance Tooling
Core
Debug, profile, and optimize performance for large-scale AI model training and inference workloads across the software stack (abstractions, compilers, runtimes, libraries, APIs) on CPUs and GPUs.
Role type
Senior IC software engineer (AI performance tooling)
Builds
Scalable, production-ready AI performance improvements for training and inference
Domain
Artificial Intelligence / High Performance Computing
Deliverable
production ML models
Required skills
C++, Python, GPU profiling, DNN/LLM inference optimization, CUDA, ROCm, Triton, PyTorch, Tensorflow, ONNX Runtime, computer architecture, hardware neural net acceleration (via careerplan.io/jobs/1970393556853720-senior-software-engineer-performance-tooling-at-microsoft)
Preferred skills
None stated
Technologies
CUDA, ROCm, Triton, PyTorch, Tensorflow, ONNX Runtime
Responsibilities
Debug and profile performance for training/inference workloads on CPUs/GPUs; Monitor performance regressions; Drive continuous improvements to reduce time-to-deploy and hardware footprint; Collaborate with researchers and engineers to deliver scalable AI performance improvements; Lead projects independently
Seniority
Senior, hands-on IC
