CareerPlan

Principal Software Engineering Manager - AI Frameworks

United States, Multiple Locations, Multiple LocationsFull-time2026-10-02 → 2026-11-10

Core

Lead and develop a team of engineers to build, benchmark, profile, debug, validate, and optimize large-scale AI training and inference workloads, ensuring production-ready performance and reliability.

Role type

Principal Software Engineering Manager (AI Frameworks)

Builds

Scalable, production-ready AI performance improvements and optimized training/inference pipelines

Domain

Artificial Intelligence / Machine Learning / High-Performance Computing

Deliverable

production ML models

Required skills

Engineering management, GPU architecture, neural network hardware acceleration, build systems, CI/CD, release engineering, developer productivity, LLM performance analysis, cross-team leadership, hiring and coaching, deep learning frameworks, GPU software stacks

Preferred skills

Advanced automation for build/test/release/benchmarking workflows, AI-assisted tooling, closed-loop systems

Technologies

C, C++, C#, Java, JavaScript, Python, Bazel, PyTorch, TensorFlow, ONNX Runtime, CUDA, ROCm, Triton

Responsibilities

Architect and design AI software stack components, oversee debugging and critical implementation decisions, establish best practices for build reliability and system observability, partner cross-functionally to deliver scalable solutions, coach and develop team members, lead cross-team initiatives to translate research into production solutions.

Seniority

Principal, hands-on IC with management responsibilities