Software Engineer, Inference Platform
Core
Design, develop, and maintain the orchestration layer for a globally distributed AI inference platform running on Cerebras datacenter clusters.
Role type
Senior IC software engineer (distributed systems/inference platform)
Builds
Production software for the Inference Platform, including Kubernetes operators, service security policies, and CI/CD pipelines.
Domain
AI infrastructure, distributed systems, cloud computing
Deliverable
production ML models | infrastructure
Required skills
Go or C++, Kubernetes, distributed systems, security (TLS/mTLS), latency optimization, system architecture
Preferred skills
ML inference infrastructure, model serving systems, GPU-accelerated workloads, TTFT/tail-latency reduction
Technologies
Kubernetes, Go, C++
