Software Architect
Core
Define the technical direction and architecture for SambaStack, a cloud-agnostic inference serving platform for generative AI and LLMs, ensuring scalability, reliability, and performance for enterprise workloads.
Role type
Principal Software Architect (AI Infrastructure)
Builds
SambaStack inference serving platform (cloud-native, on-prem, or cloud) for enterprise AI inference
Domain
AI Infrastructure / High-Performance Computing / Distributed Systems
Deliverable
production ML models
Required skills
Distributed systems architecture, Kubernetes (Operators, Helm), Backend development (Python, Go, Rust), Technical leadership, System design, Cross-functional alignment
Preferred skills
AI inference serving, Custom hardware accelerators (RDU, GPUs, TPUs), ML productionization, Enterprise SLA/compliance, AI developer tooling
Technologies
Kubernetes, Python, Go, Rust, Helm Charts, Operators, RDU
Responsibilities
Own end-to-end technical architecture for the SambaStack platform, Define and drive architectural strategy across engineering teams, Lead design reviews for major capabilities, Identify and resolve systemic risks (performance, reliability, scaling), Establish architectural standards and best practices, Partner with ML Engineers and Product Managers to translate requirements, Mentor engineers on architectural thinking, Evaluate emerging technologies for the technical roadmap
Seniority
Principal, organization-wide influence
