Senior Software Engineer - AI Inference Performance
Core
Senior Software Engineer advancing LLM and VLM inference performance on NVIDIA GPU-accelerated systems by optimizing latency, throughput, and efficiency across models, serving software, and distributed runtimes.
Role type
Senior IC software engineer (AI inference performance)
Builds
High-performance inference engines and production deployment optimizations for NVIDIA platforms
Domain
AI/ML, High-Performance Computing, GPU Architecture
Deliverable
production ML models
Required skills
CUDA programming, Python, Rust, C++, GPU architecture expertise, performance modeling (roofline, speed-of-light), distributed systems, kernel optimization, profiling (Nsight Systems/Compute)
Preferred skills
Open-source contributions (TensorRT-LLM, vLLM, SGLang), AI-agent-supported performance workflows, published research
Technologies
CUDA, CUTLASS, Triton, PyTorch, Nsight Systems, Nsight Compute, TensorRT-LLM, vLLM, SGLang
Responsibilities
Lead end-to-end analysis of LLM/VLM inference processes; Build speed-of-light and roofline models; Profile workloads to eliminate bottlenecks; Tune serving hyperparameters and techniques; Build and optimize performance-critical kernels; Establish repeatable benchmarks and manage performance regression gates
Seniority
Senior, hands-on IC