Senior Software Engineer, AI Infrastructure
Core
Build infrastructure to help AI workloads start faster and run efficiently at scale.
Role type
Senior Software Engineer (AI Infrastructure)
Builds
Scalable services, APIs, and libraries for managing and loading AI models and data within Kubernetes environments.
Domain
AI Infrastructure / Distributed Systems
Deliverable
production ML models
Required skills
Python, Go, Kubernetes, distributed systems, Linux, containerization, production software delivery, AI tools usage
Preferred skills
AI model loading/inference frameworks (PyTorch, vLLM, SGLang), cloud storage/caching, open-source project maintenance, C++, GPU computing
Technologies
Python, Go, Kubernetes, PyTorch, vLLM, SGLang
Responsibilities
Develop scalable services and APIs for AI model management; Integrate cloud infrastructure and AI frameworks in Kubernetes; Guide open-source project technical direction and coordinate releases; Deliver features from design to production with testing and monitoring; Collaborate on technical decisions and share knowledge.
Seniority
Senior, hands-on IC