AI Framework Software Engineer – SGlang & Kernels
Core
Design, develop, and optimize AI software frameworks (e.g., SGLang) and distributed algorithms for machine learning and deep learning.
Role type
Senior IC AI framework software engineer
Builds
AI frameworks, distributed model/data parallel systems, and optimized kernels for computing hardware backends
Domain
Artificial Intelligence / Deep Learning / High-Performance Computing
Deliverable
production ML models
Required skills
C++, Python, Deep Learning theory, distributed algorithms, computational graph transformation, performance profiling, hardware backend optimization
Preferred skills
PyTorch, SGLang, vLLM, LLM model structure knowledge, high-efficiency kernel development
Technologies
SGLang, PyTorch, vLLM, C++, Python
Responsibilities
Design and develop AI software frameworks; implement distributed algorithms (model/data parallel, parameter servers, asynchronous dataflow); transform computational graph representations; profile distributed deep learning models to identify bottlenecks; optimize code for various computing hardware backends
Seniority
Senior, hands-on IC
