Software Engineer, Infrastructure
Core
Building the scalable, secure, and robust backbone (control plane and data plane) for Anyscale's cloud platform to enable distributed AI/ML workloads.
Role type
Senior IC infrastructure software engineer (distributed systems)
Builds
Scalable control plane and data plane services for Ray clusters across cloud and on-prem environments
Domain
Cloud-native distributed systems and AI infrastructure
Deliverable
production ML models | infrastructure
Required skills
Go, Python, Kubernetes, cloud-native technologies (AWS, Azure, GCP), distributed systems architecture, networking, security, authentication, observability stacks (Prometheus, Grafana), Linux kernel, container orchestration, accelerator integration (GPUs, TPUs)
Preferred skills
Experience with open-source Ray, infinite laptop product, heterogeneous compute clusters
Technologies
Ray, Kubernetes, AWS, Azure, GCP, Prometheus, Grafana, Linux
Responsibilities
Design and build services to orchestrate Ray clusters; optimize control plane components for large-scale workloads; build intelligent scheduling and resource management systems; develop features for reliability, performance, scalability, and observability; support and optimize accelerator integration; handle container image management and dependency resolution; provide on-call support for infrastructure issues
Seniority
Senior, hands-on IC