Research Scientist / Research Engineer, Inference Systems
Hybrid
Core
Designing and building high-performance inference systems for LLMs, focusing on disaggregation, tiered caching, and large MoE models to optimize serving economics.
Role type
Senior IC research scientist/engineer (inference systems)
Builds
Production inference serving stack and system-level improvements for AI cloud platform
Domain
AI/ML infrastructure, LLM serving, high-performance computing
Deliverable
production ML models
Required skills
LLM inference and serving systems, inference engines (vLLM, SGLang), Python, C++, system-level optimization, research methodology
Preferred skills
distributed serving experience, publications at top systems venues, open-source contributions to inference projects
Technologies
vLLM, SGLang, Python, C++
