GPU Kernel Engineer
Core
Design and optimize custom GPU kernels to power next-generation large-scale AI systems, specifically focusing on large-scale LLM training and inference.
Role type
Senior IC GPU Kernel Engineer
Builds
Optimized GPU kernels integrated into high-level ML frameworks (PyTorch, JAX) for frontier AI models
Domain
AI Infrastructure / High-Performance Computing / GPU Programming
Deliverable
production ML models
Required skills
C++, CUDA, ROCm, Triton, JAX Pallas, PTX, GPU memory models, performance profiling, low-level kernel development, framework integration
Preferred skills
AMD GPU optimization, JAX FFI, model serving frameworks (vLLM, TensorRT), TPU/XLA programming, open-source contributions
Technologies
CUDA, ROCm, Triton, JAX, PyTorch, PTX, C++, Python
Responsibilities
Design and implement custom GPU kernels; Profile and optimize end-to-end performance of ML operations; Integrate low-level kernels into ML frameworks; Develop performance models and identify bottlenecks; Collaborate with distributed systems engineers; Work with hardware vendors on architecture capabilities; Contribute to tooling and benchmarking suites
Seniority
Senior, hands-on IC
