Staff Software Engineer, AI Compute Platform
Core
Design and build a secure, reliable, and easy-to-use platform for running AI workloads at scale, including control-plane services, APIs, and orchestration systems.
Role type
Staff Software Engineer (AI Compute Platform) (via careerplan.io/jobs/100399715600-staff-software-engineer-ai-compute-platform-at-arm)
Builds
Distributed training, evaluation, and inference capabilities for Arm's AI workloads
Domain
Cloud infrastructure / AI Compute Platform
Deliverable
production ML models
Required skills
Distributed systems, Kubernetes, Go/Python, APIs, asynchronous workflows, relational databases
Preferred skills
Kubernetes operators/schedulers, RPC systems, Kafka, OpenTelemetry, PyTorch, Ray, vLLM
Technologies
Kubernetes, Go, Python, PostgreSQL, Kafka, OpenTelemetry, Prometheus, Grafana, PyTorch, Ray, vLLM
Responsibilities
Build scalable backend services and APIs; Develop Kubernetes controllers for workload management; Deliver secure multi-tenant capabilities; Improve platform scalability and observability; Partner across teams to deliver distributed training and inference capabilities
Seniority
Staff, technical leadership & mentorship