Staff Software Engineer - Serverless
Core
Technically lead and build the software layer for a serverless platform that enables developers to deploy AI models and run workloads without managing infrastructure.
Role type
Staff Software Engineer (Serverless Platform)
Builds
Serverless execution platform, control plane, SDKs, and observability systems for AI workloads
Domain
Cloud Infrastructure / AI/ML Inference
Deliverable
production ML models
Required skills
Distributed systems, workload orchestration, async processing, API design, backend engineering (Python/Go), system design, technical leadership
Preferred skills
Serverless platforms, GPU-backed workloads, AI/ML inference, container orchestration, multi-tenant isolation
Technologies
vLLM, TensorRT, Triton, Kubernetes, Nomad, Knative
Responsibilities
Build core systems for workload execution, routing, scheduling, and scaling; design control plane APIs and lifecycle management; improve GPU utilization and model warm-up; build global observability; mentor engineers and define standards
Seniority
Staff, hands-on IC with technical leadership