Research Engineer, Infrastructure, Kernels
Core
Design, optimize, and maintain compute foundations and high-performance ML kernels for large-scale language model training.
Role type
Senior IC infrastructure research engineer (ML kernels)
Builds
Custom ML kernels, compute primitives, and performance benchmarks for LLM training
Domain
AI/ML infrastructure, GPU computing, distributed systems
Deliverable
production ML models
Required skills
CUDA, CuTe, Triton, deep learning frameworks (PyTorch, JAX), GPU programming, compute profiling, low-precision arithmetic, distributed compute stacks
Preferred skills
Large-scale LLM training experience, tensor/pipeline parallelism, low-precision formats (FP8, INT8), compiler stacks (XLA, TVM), open-source contributions
Technologies
CUDA, CuTe, Triton, PyTorch, JAX, XLA, TVM
Responsibilities
Design and implement custom ML kernels for core LLM operations; optimize compute primitives to reduce memory bandwidth bottlenecks; collaborate with research teams on kernel-level optimizations; develop reusable kernel libraries and benchmarks; ensure infrastructure stability and scalability; document insights via talks or papers
Seniority
Senior, hands-on IC