Software Engineer Intern, AI and DL Kernel Libraries - 2027
Core
Develop foundational software and low-level kernels for NVIDIA's AI platform, focusing on deep learning primitives, runtime systems, and performance-critical GPU software for large language models and generative AI.
Role type
Software Engineer Intern (AI/DL Kernel Libraries)
Builds
Production-quality software for NVIDIA's AI stack including cuDNN, FlashInfer, and optimized support for LLM inference workloads.
Domain
AI/Deep Learning Systems, GPU Computing, High-Performance Computing
Deliverable
production ML models
Required skills
C/C++, Python, CUDA, Deep Learning Frameworks (PyTorch, JAX, TensorFlow, ONNX), Linear Algebra, Performance Analysis, Code Optimization
Preferred skills
Inference Engines (vLLM, SGLang, TensorRT-LLM), Domain-Specific Compilers, Machine Learning Compilers (MLIR, Apache TVM), GPU Performance Modeling, Open Source Contributions
Technologies
CUDA, cuDNN, FlashInfer, PyTorch, JAX, TensorFlow, ONNX, vLLM, SGLang, TensorRT-LLM, MLIR, Apache TVM, TensorIR
Responsibilities
Design and optimize kernels for high-impact AI workloads; Assist in building extensible software abstractions for deep learning libraries and runtime systems; Contribute to just-in-time compilation and code generation technologies; Analyze workload performance and tune software; Collaborate with engineers across deep learning frameworks, compilers, and GPU architecture teams.
Seniority
Intern