Head of Engineering
Core
Lead the organization developing systems that power vLLM and Inferact, focusing on AI inference engine performance and hardware-software co-design.
Role type
Senior IC engineering leader (Head of Engineering)
Builds
High-performance AI inference systems and the vLLM open-source engine
Domain
AI Infrastructure / ML Systems / GPU Accelerators
Deliverable
production ML models
Required skills
Engineering leadership, LLM inference, ML systems optimization, GPU/accelerator software, distributed systems, hardware-software co-design, team scaling, technical credibility
Preferred skills
LLM serving, vLLM/SGLang experience, compiler/runtime systems, PhD talent integration, open-source community engagement (via careerplan.io/jobs/20df5968-cafb-4007-a6f6-ad854411b501-head-of-engineering-at-inferact)
Technologies
vLLM, SGLang, PyTorch, Ray, Triton, XLA, ROCm
Responsibilities
Scale a senior-heavy engineering team, recruit and develop rare ML systems talent, translate research into execution plans, strengthen team operations, deliver reliable high-performance inference
Seniority
Senior, hands-on IC
