Senior Software Engineer – ML Inference Runtime
Core
Develop C++, C, and Python software integrating machine-learning frameworks and LLM runtimes with Arm hardware acceleration technologies.
Role type
Senior IC software engineer (ML inference runtime) (via careerplan.io/jobs/100035000640-senior-software-engineer-ml-inference-runtime-at-arm)
Builds
Integrations between ML frameworks, runtimes, and hardware-acceleration technologies
Domain
Hardware acceleration / Machine Learning
Deliverable
production ML models
Required skills
C++, C, Python, LLM inference, Git, CI/CD, automated testing, technical leadership
Preferred skills
llama.cpp, workload profiling, compiler/ML graph technologies, Vulkan/GPU compute APIs, AI-assisted development tools
Technologies
C++, C, Python, llama.cpp, Arm acceleration, Vulkan, GPU compute
Responsibilities
Design and implement integrations between ML frameworks, runtimes, and hardware-acceleration technologies; analyse and improve performance of ML and LLM workloads; lead significant work from design through delivery; mentor junior engineers
Seniority
Senior, hands-on IC with leadership
