Inference Engineering and Product Lead
Core
Lead the direction and execution of Modal's LLM inference platform, managing a team of engineers building the serving stack, routing infrastructure, and agentic optimization platform.
Role type
Senior IC product lead (LLM inference infrastructure)
Builds
LLM inference platform, serving stack, routing infrastructure, internal agentic optimization platform
Domain
Cloud infrastructure, distributed computing, LLM inference
Deliverable
production ML models
Required skills
team leadership, high-performance system design, cloud infrastructure, low-level OS foundations (Linux kernel, containers), product strategy, cross-functional collaboration
Preferred skills
LLM inference production experience, engine/kernels knowledge, KV cache management, speculative decoding
Technologies
Linux kernel, containers, multi-cloud substrate
Responsibilities
Recruit and grow high-performing engineering teams; drive technical and product decisions through design and code reviews; partner with business operations on compute strategy; collaborate with GTM on product launches and positioning.
Seniority
Senior, hands-on IC with people management
