Member of Technical Staff, Performance and Scale
Core
Design and implement foundational distributed systems layers to enable vLLM to serve AI models across thousands of accelerators with minimal latency and maximum reliability.
Role type
Senior IC infrastructure engineer (distributed systems)
Builds
Distributed inference infrastructure for vLLM
Domain
AI inference, high-performance computing, distributed systems
Deliverable
production ML models
Required skills
Systems programming in Rust/Go/C++, High-performance distributed systems design, Network protocols, High-performance I/O, Complex distributed systems debugging
Preferred skills
ML serving infrastructure, Disaggregated inference architecture, GPU programming models, GPU memory hierarchies, GPU interconnects (NVLink, InfiniBand, RoCE), System reliability at scale
Technologies
vLLM, Rust, Go, C++, NVLink, InfiniBand, RoCE
Responsibilities
Design and implement foundational layers for distributed inference, Optimize system performance and reliability at scale, Debug complex distributed systems issues
Seniority
Senior, hands-on IC
