SW Engineer, Sr Staff - LLM Serving (Cloud AI) - Cork, Ireland
Core
Developing software solutions for Inference Acceleration for LLMs and multi-modal models.
Role type
Sr Staff Software Engineer (LLM Serving & Inference Acceleration)
Builds
Commercial software for inference acceleration spanning R&D to deployment
Domain
Cloud AI, LLMs, Multi-modal models, Systems Engineering
Deliverable
production ML models
Required skills
LLM serving frameworks (vLLM), PyTorch, C++, Python, neural network optimization, multi-core architecture, SoC architecture, performance modeling
Preferred skills
Machine learning accelerators, neural network operators, linear algebra, math libraries
Responsibilities
Design, compiler technology, performance modeling, bottleneck analysis, executing and optimizing neural networks, writing high performance software for multicore systems, analyzing software/hardware performance on multi-core architectures
Seniority
Sr Staff, hands-on IC with strategy & mentorship
