Senior Compiler Engineer - AI
Core
Design and implement program transformations on JAX programs (jaxpr) for large-scale training, optimizing compilers and runtime execution frameworks for accelerating deep learning training on large scale distributed systems.
Role type
Senior IC compiler engineer (distributed deep learning)
Builds
JaxPP, NVIDIA's open-source library for pipeline parallelism in JAX
Domain
Deep learning, distributed systems, compiler technology
Deliverable
production ML models
Required skills
Compiler design and implementation, Distributed system design, Deep learning frameworks (JAX, PyTorch), GPU training and inference, C/C++ and Python programming, Parallel computing libraries (MPI)
Preferred skills
JAX internals (jaxpr, tracing, sharding), XLA, StableHLO, MLIR, GPU communication libraries (NCCL, NVSHMEM, RDMA), CUDA programming, Open-source contributions
Technologies
JAX, XLA, NCCL, CUDA, Python, C/C++, MPI, MaxText
Responsibilities
Design and implement program transformations on JAX programs (jaxpr) for large-scale training, Develop technologies and products involving optimizing compilers and runtime execution frameworks, Work on compiling a graph intermediate representation (IR) to target specific code, Contribute to advancing the state of the art in compiler technology for delivering high performance on large-scale training workloads, Collaborate with members of the software framework teams and hardware architecture teams, Be a core contributor to the open-source JaxPP project
Seniority
Senior, hands-on IC
