CareerPlan

Research Engineer, Infrastructure, Kernels

San FranciscoFull-time$400k–$500k2026-08-04 → 2026-11-19
On-siteVisa sponsorship offered

Core

Design, optimize, and maintain compute foundations and high-performance ML kernels for large-scale language model training.

Role type

Senior IC infrastructure research engineer (ML kernels)

Builds

Custom ML kernels, compute primitives, and performance benchmarks for LLM training

Domain

AI/ML infrastructure, GPU computing, distributed systems

Deliverable

production ML models

Required skills

CUDA, CuTe, Triton, deep learning frameworks (PyTorch, JAX), GPU programming, compute profiling, low-precision arithmetic, distributed compute stacks

Preferred skills

Large-scale LLM training experience, tensor/pipeline parallelism, low-precision formats (FP8, INT8), compiler stacks (XLA, TVM), open-source contributions

Technologies

CUDA, CuTe, Triton, PyTorch, JAX, XLA, TVM

Responsibilities

Design and implement custom ML kernels for core LLM operations; optimize compute primitives to reduce memory bandwidth bottlenecks; collaborate with research teams on kernel-level optimizations; develop reusable kernel libraries and benchmarks; ensure infrastructure stability and scalability; document insights via talks or papers

Seniority

Senior, hands-on IC