Runtime Engineer
Core
Building and optimizing the lowest-level runtime stack for a full-stack generative AI platform to enable high-performance ML training and inference on proprietary silicon.
Role type
Senior IC systems software engineer (runtime stack)
Builds
High-performance distributed software execution environment for SambaNova DataScale & Cloud platforms
Domain
AI/ML infrastructure, high-performance computing (HPC), proprietary silicon
Deliverable
production ML models | infrastructure
Required skills
C/C++, Python, user space libraries, operating systems, kernel drivers, distributed systems, performance tuning
Preferred skills
PCIe, Infiniband, RoCE, RDMA, fast networking stacks
Technologies
C, C++, Python, PCIe, Infiniband, RoCE, RDMA
Responsibilities
Design and implement new features of the runtime stack for scalable ML inference and training; provide system software support (drivers and kernel) for next-generation silicon; design user-space libraries for high hardware utilization; build user-facing tools for system management and profiling; collaborate with Hardware, ML Application, Compiler, and DevOps teams.
Seniority
Mid-level, hands-on IC