CareerPlan

Senior Software Engineer - AI Inference Performance

US, CA, Santa ClaraFull-time$184k–$288k2026-09-28 → 2026-11-18

Core

Senior Software Engineer advancing LLM and VLM inference performance on NVIDIA GPU-accelerated systems by optimizing latency, throughput, and efficiency across models, serving software, and distributed runtimes.

Role type

Senior IC software engineer (AI inference performance)

Builds

High-performance inference engines and production deployment optimizations for NVIDIA platforms

Domain

AI/ML, High-Performance Computing, GPU Architecture

Deliverable

production ML models

Required skills

CUDA programming, Python, Rust, C++, GPU architecture expertise, performance modeling (roofline, speed-of-light), distributed systems, kernel optimization, profiling (Nsight Systems/Compute)

Preferred skills

Open-source contributions (TensorRT-LLM, vLLM, SGLang), AI-agent-supported performance workflows, published research

Technologies

CUDA, CUTLASS, Triton, PyTorch, Nsight Systems, Nsight Compute, TensorRT-LLM, vLLM, SGLang

Responsibilities

Lead end-to-end analysis of LLM/VLM inference processes; Build speed-of-light and roofline models; Profile workloads to eliminate bottlenecks; Tune serving hyperparameters and techniques; Build and optimize performance-critical kernels; Establish repeatable benchmarks and manage performance regression gates

Seniority

Senior, hands-on IC