AI/ML Software Engineer
Core
Building high-performance compiler infrastructure and runtime systems to optimize and deploy LLMs and Generative AI models on RISC-V architectures.
Role type
Senior IC AI/ML Software Engineer (Compiler & Runtime Systems)
Builds
Compiler stacks (MLIR/IREE/Triton), distributed runtime systems, and hardware-software interfaces for AI workloads.
Domain
Chip design, AI/ML, RISC-V architecture, compiler infrastructure
Deliverable
production ML models
Required skills
C++, Python, LLMs, Diffusion models, Transformers, MLIR, IREE, Triton, system programming, memory management, distributed computing, model parallelism, tensor sharding, RISC-V Vector (RVV), custom ISA extensions
Preferred skills
PyTorch, ONNX Runtime, TF/TFLite, distributed training/inference, collective communications, open-source contributions, low-level performance tuning, MLPerf benchmarking
Technologies
MLIR, IREE, Triton, LLVM, PyTorch, ONNX Runtime, TF/TFLite, RISC-V
Responsibilities
Develop and maintain MLIR/IREE/Triton compiler stacks; design and implement single/multi-device scheduling and memory management layers; implement model sharding and distribution strategies; analyze and profile AI models to identify bottlenecks; collaborate with hardware architects to influence future AI accelerator designs.
Seniority
Senior, hands-on IC
