Staff + Sr. Software Engineer, Cloud Inference
Core
Design, build, and own backend services and infrastructure to scale Claude LLM inference across multiple cloud providers (AWS, GCP, Azure), managing capacity, routing, and operations.
Role type
Staff/Senior Backend Engineer (Cloud Inference)
Builds
End-to-end serving stack for Claude on cloud platforms, including API integration, intelligent request routing, inference execution, and capacity management systems.
Domain
Cloud Infrastructure / Large Language Model Serving
Deliverable
production ML models
Required skills
High-performance distributed systems, cloud platform expertise (AWS/GCP/Azure), Kubernetes/container orchestration, Infrastructure as Code, cross-functional collaboration, autonomous ownership, rapid technology ramp-up.
Preferred skills
Multi-cloud scaling experience, capacity management and cost optimization, multi-region deployments and global traffic management, Python or Rust proficiency.
Technologies
AWS, GCP, Azure, Kubernetes, Infrastructure as Code, Python, Rust
Responsibilities
Design backend services and infrastructure for Claude across CSPs; Work with internal teams and CSP partners to stand up serving stacks; Build CI/CD automation for model deployments; Design interfaces and tooling abstractions for cost-effective inference; Contribute to capacity planning, autoscaling, and workload routing; Analyze observability data to identify performance bottlenecks and drive remediation.
Seniority
Staff/Senior, hands-on IC