CareerPlanSign in

Senior and/or Principal Software Engineer - AI Frameworks

United States, Multiple Locations, Multiple Locations💼 Full-time🗓 2026-08-04 → 2026-09-26

Core

Design, implement, test, and operate production-quality components across AI frameworks, runtimes, benchmarking systems, performance tooling, and service integrations.

Role type

Senior/Principal IC software engineer (AI frameworks & performance tooling)

Builds

Production AI frameworks, runtimes, benchmarking systems, performance tooling, and service integrations

Domain

AI/ML infrastructure, high-performance computing, GPU software

Deliverable

production ML models | infrastructure

Required skills

C++ or Python, performance analysis, benchmarking, automation, developer tooling, AI/ML frameworks (PyTorch, TensorFlow, ONNX Runtime), GPU software (CUDA, ROCm, Triton), cross-team collaboration, technical ownership, software architecture, computer architecture, accelerator-aware optimization, AI/ML workloads, leadership of cross-team technical initiatives, creating reusable platforms, influencing senior stakeholders, mentoring technical leaders

Preferred skills

None stated

Technologies

PyTorch, TensorFlow, ONNX Runtime, CUDA, ROCm, Triton

Responsibilities

Design, implement, test, and operate production-quality components across AI frameworks, runtimes, benchmarking systems, performance tooling, and service integrations; Build automation and observability that detect regressions, improve reproducibility, surface actionable insights, and accelerate model and hardware onboarding; Drive scoped projects from problem definition through deployment, balancing delivery speed, maintainability, reliability, and measurable customer or capacity impact; Partner with researchers, model teams, infrastructure owners, and hardware vendors to diagnose cross-stack issues and deliver production-ready solutions; Contribute to technical design reviews, engineering standards, operational health, and mentoring of other engineers; Establish common measurement, automation, observability, and engineering mechanisms that turn one-off analyses into scalable platform capabilities; Provide hands-on technical leadership through prototypes, critical-path implementation, design and code reviews, complex debugging, and operational readiness

Seniority

Senior/Principal, hands-on IC with strategy & mentorship

Sourced via microsoft · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.