Operating Systems Engineer, On-Device Inference | Consumer Devices
Core
Design, develop, and ship the OS stack enabling reliable, responsive, and energy-efficient on-device AI inference on consumer devices.
Role type
Senior IC Operating Systems Engineer (On-Device Inference)
Builds
Inference platform services, frameworks, and runtime integrations for consumer hardware
Domain
Consumer electronics, embedded systems, operating systems, AI inference
Deliverable
production ML models
Required skills
C++ (concurrent programming, memory ownership), OS component design, inference runtime integration, model quantization/compression, system scheduling, performance/power optimization, cross-stack debugging
Preferred skills
Rust (systems programming), end-to-end on-device inference delivery, CPU/GPU/neural accelerator optimization, full-solution ownership
Technologies
C++, Rust, inference runtimes, neural accelerators, embedded systems
Responsibilities
Design and implement OS services and frameworks for inference execution and resource management; Optimize models for device constraints (memory, compute, energy); Develop scheduling policies balancing inference with other device activities; Create diagnostic tools and automated tests for performance validation; Debug correctness, concurrency, and performance issues across the stack; Collaborate with research and hardware teams to ship production features
Seniority
Senior, hands-on IC
