Senior Software Engineer, Cloud Development
Core
Design, build, and operate core platform services and APIs for deploying and serving production ML workloads at scale.
Role type
Senior Software Engineer (Cloud Development & ML Infrastructure)
Builds
Model training pipelines, high-throughput inference services, GPU orchestration, and secure AI systems.
Domain
Cloud Infrastructure, Machine Learning, Distributed Systems
Deliverable
production ML models | infrastructure
Required skills
Python, Kubernetes, Helm, Terraform, Cloud Infrastructure (GCP/GKE), Scalable API Design, Observability (Grafana), Incident Response
Preferred skills
Ray/Ray Serve, Stateless ML Services, Multi-provider LLM Gateway, Privacy-preserving ML techniques, Open-source contributions
Technologies
Python, Kubernetes, Helm, Terraform, GCP, GKE, Grafana, Ray, Ray Serve
Responsibilities
Design and manage Kubernetes-based workloads with GitOps pipelines; Optimize backend services for throughput, latency, and cost; Implement observability practices (metrics, logging, tracing); Partner with product and security teams to design scalable platform capabilities; Mentor junior engineers through code reviews.
Seniority
Senior, hands-on IC