Developer Technology Engineering Intern - 2027
Core
Build and optimize core parallel algorithms, data structures, and GPU kernels for large language model training and inference, while improving distributed communication for high-performance computing workloads.
Role type
Intern, GPU software engineer (LLM/HPC)
Builds
GPU-accelerated libraries, frameworks, and open-source projects for LLM training and inference
Domain
Artificial Intelligence, High-Performance Computing, GPU Architecture
Deliverable
production ML models
Required skills
C/C++/Python/Fortran, parallel programming, GPU kernel optimization, distributed systems, linear algebra, numerical methods, system architecture
Preferred skills
LLM framework optimization, distributed communication optimization, NVLink/InfiniBand/RoCE expertise, open-source contribution
Technologies
Megatron, TRTLLM, SGLang, vLLM, cuDNN, cuBLAS, CUTLASS, DeepGEMM, FlashMLA, FlashAttention, Flashinfer, NCCL, NVSHMEM, DeepEP
Responsibilities
Build and optimize parallel algorithms and data structures for GPU workloads; Collaborate with architecture and research teams to influence next-generation platforms; Optimize high-performance operators and GPU kernels; Improve communication for distributed large language model workloads
Seniority
Intern
