Software Engineer
Core
Building and scaling a cloud-agnostic, enterprise-grade AI inference serving platform (SambaStack) that hosts foundation model workloads for enterprises and service providers.
Role type
Senior Software Engineer (AI Infrastructure)
Builds
SambaStack inference platform, RDU hardware architecture integration, and cloud-native serving systems.
Domain
Generative AI infrastructure, high-performance computing, enterprise software.
Deliverable
production ML models
Required skills
Python, Go, Rust, Kubernetes, Kubernetes Operator pattern, unit/integration/E2E testing framework design, backend component development, system scalability design.
Preferred skills
AI inference serving and orchestration, AI coding assistants, ML application optimization, cloud-native software system design.
Technologies
Python, Go, Rust, Kubernetes, RDU architecture.
Responsibilities
Ensure stability, scalability, and performance of the AI inference platform; collaborate with ML Engineers and DevOps to build best-in-class systems; work on components across a heterogeneous serving platform; build testing frameworks for rapid high-quality releases; design new systems to solve problems in the AI inference space.
Seniority
Mid-to-Senior, hands-on IC