CareerPlanGet AI match score →

Software Engineer, Inference Platform

Headquarters/Sunnyvale Office💼 Full-time🗓 2026-06-20 → 2026-07-31

Core

Design, develop, and maintain the orchestration layer for a globally distributed AI inference platform running on Cerebras datacenter clusters.

Role type

Senior IC software engineer (distributed systems/inference platform)

Builds

Production software for the Inference Platform, including Kubernetes operators, service security policies, and CI/CD pipelines.

Domain

AI infrastructure, distributed systems, cloud computing

Deliverable

production ML models | infrastructure

Required skills

Go or C++, Kubernetes, distributed systems, security (TLS/mTLS), latency optimization, system architecture

Preferred skills

ML inference infrastructure, model serving systems, GPU-accelerated workloads, TTFT/tail-latency reduction

Technologies

Kubernetes, Go, C++

Sourced via ashby · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.
Apply on Ashby ↗