CareerPlanSign in

On-device ML Infrastructure Engineer

USA💼 Full-time🗓 2026-09-03 → 2026-09-25

Core

Develop and improve core runtime infrastructure for machine learning model execution across Apple devices, focusing on execution stability, performance, and optimization.

Role type

Senior IC machine learning infrastructure engineer (on-device)

Builds

Core runtime infrastructure, model orchestration capabilities, and tooling for efficient ML model execution on Apple hardware.

Domain

Consumer electronics / Machine Learning Infrastructure

Deliverable

production ML models

Required skills

Python 3, C++, Swift, machine learning model architectures, PyTorch, kernel development, profiling, benchmarking, debugging

Preferred skills

MLIR-based compilers, Apple platform deployment, GPU/CPU/Neural Engine programming paradigms, kernel writing for ML execution

Technologies

Python, C++, Swift, PyTorch, MLIR, Neural Engine, GPU, CPU

Responsibilities

Develop and improve core runtime infrastructure for ML model execution; Build model orchestration capabilities; Collaborate with model authoring, compiler, and runtime teams; Support model optimization, transformation, debugging, profiling, and benchmarking; Write kernels and contribute to tooling for efficient ML model execution.

Seniority

Mid-level, hands-on IC

Sourced via codingjobboard · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.