AI Research Engineer (Kernel & Inference Optimization) - 100% Remote Worldwide
Core
Design and optimize model serving architectures and inference frameworks for advanced AI systems, focusing on low-latency, high-throughput performance on resource-constrained devices and edge platforms.
Role type
Senior IC AI Research Engineer (Kernel & Inference Optimization)
Builds
High-performance inference pipelines and serving engines for mobile and edge applications
Domain
Fintech / AI Infrastructure / Mobile Computing
Deliverable
production ML models
Required skills
GPU kernel development (Metal Shading Language), low-level kernel optimization, model serving architecture design, distributed inference systems (Tensor/Pipeline/Expert Parallelism), Diffusion Models, Vision Transformers, model quantization and pruning, Flash attention, KV Cache, speculative decoding
Preferred skills
PhD in NLP/Machine Learning, publications in A* conferences, experience with multi-modal architectures (text, images, audio)
Technologies
Metal Shading Language (MSL), GPU clusters, mobile device inference frameworks
Responsibilities
Design and deploy state-of-the-art model serving architectures; Build, run, and monitor controlled inference tests in simulated and live environments; Identify and prepare high-quality test datasets for low-resource devices; Analyze computational efficiency and diagnose bottlenecks in serving pipelines; Integrate optimized serving frameworks into production pipelines for edge applications
Seniority
Senior, hands-on IC
