Sr. Machine Learning - Compiler Engineer III, AWS Neuron, Annapurna Labs
Core
Building next-generation compilers to optimize deep learning models (LLMs, vision transformers) for deployment on AWS Inferentia and Trainium custom chips.
Role type
Senior IC compiler engineer (hardware/software co-design)
Builds
Optimized ML model implementations for AWS accelerators
Domain
Cloud infrastructure + AI hardware acceleration
Deliverable
production ML models
Required skills
C++, compiler architecture, system design, ML framework internals, open-source collaboration
Preferred skills
GPU compiler experience, MLIR, StableHLO, OpenXLA
Technologies
C++, PyTorch, TensorFlow, JAX, MLIR, StableHLO, OpenXLA
Responsibilities
Design and implement compiler optimization and verification passes, build features to surface accelerator peculiarities to developers, implement tools to analyze numerical errors, resolve root causes of compiler defects, partner with chip architects and ML teams
Seniority
Senior, hands-on IC with mentorship responsibilities