AI Framework Software Engineer - vLLM
Core
Design, develop, and optimize AI frameworks (vLLM, PyTorch) and distributed algorithms for high-performance deep learning applications.
Role type
Senior IC AI Framework Software Engineer
Builds
Distributed AI inference frameworks and high-performance ML primitives
Domain
Artificial Intelligence / Deep Learning / High-Performance Computing
Deliverable
production ML models
Required skills
Python, C++, distributed algorithms, deep learning concepts, computational graph optimization, performance profiling, software debugging
Preferred skills
Large language model inference stacks, GPU architecture knowledge, open-source contribution experience
Technologies
vLLM, PyTorch
Responsibilities
Design and optimize AI frameworks; implement distributed algorithms and asynchronous data communication; transform computational graph representations; profile deep learning models to identify bottlenecks; collaborate with researchers to integrate advancements; contribute to open-source projects
Seniority
Senior, hands-on IC