AI Research Engineer (Kernel & Inference Optimization) - 100% Remote Worldwide
Core
Design and optimize model serving architectures and inference pipelines for advanced AI systems, focusing on low-latency, high-throughput performance on resource-constrained devices and edge platforms.
Role type
Senior IC AI Research Engineer (Kernel & Inference Optimization)
Builds
High-performance inference engines and serving frameworks for mobile and edge applications
Domain
AI/ML, Mobile Computing, Edge Computing, Distributed Systems
Deliverable
production ML models
Required skills
GPU kernel development (MSL), low-level optimization, model serving architectures, distributed inference (Tensor/Pipeline/Expert Parallelism), Diffusion Models, Vision Transformers, Pruning, Quantization, Flash Attention, KV Cache, Speculative Decoding
Preferred skills
PhD in NLP/ML, publications in A* conferences, experience with mobile GPU compute shaders
Technologies
Metal Shading Language (MSL), GPU clusters, Tensor Parallelism, Pipeline Parallelism, Expert Parallelism
Responsibilities
Design and deploy state-of-the-art model serving architectures; Build, run, and monitor controlled inference tests; Identify and prepare high-quality test datasets; Analyze computational efficiency and diagnose bottlenecks; Integrate optimized frameworks into production pipelines
Seniority
Senior, hands-on IC
