AI Framework Software Engineer
Core
Design, develop, and optimize AI software frameworks and distributed algorithms for machine learning and deep learning models.
Role type
AI Framework Software Engineer
Builds
AI frameworks (e.g., SGLang), distributed model/data parallel frameworks, parameter servers, and deep learning primitives.
Domain
Artificial Intelligence / Deep Learning / High-Performance Computing
Deliverable
production ML models
Required skills
C++, Python, Deep Learning theory, distributed algorithms, performance optimization, computational graph transformation
Preferred skills
PyTorch, SGLang, vLLM, LLM model structure understanding, high-efficiency kernel development
Technologies
C++, Python, PyTorch, SGLang, vLLM
Responsibilities
Design and develop AI software frameworks; implement distributed algorithms; optimize code for computing hardware backends; profile distributed deep learning models to identify performance bottlenecks.
Seniority
Mid-level IC