Principal Software Engineer, AI Compute Platform
Core
Design and build a secure, reliable, and easy-to-use platform for running AI workloads at scale, including control-plane services, APIs, and orchestration systems.
Role type
Principal Software Engineer (AI Compute Platform)
Builds
Control-plane services, APIs, orchestration systems, and developer tools for distributed training and inference
Domain
Cloud infrastructure + AI/ML compute platforms
Deliverable
production ML models
Required skills
Distributed systems, Kubernetes, Go/Python, APIs, asynchronous processing, relational databases
Preferred skills
Kubernetes operators/schedulers, RPC systems, PostgreSQL, Kafka, OpenTelemetry, Prometheus, Grafana, PyTorch, Ray, vLLM
Responsibilities
Build scalable backend services and asynchronous workflows; Develop Kubernetes controllers for workload management; Deliver secure multi-tenant capabilities; Improve platform scalability and observability; Partner across teams to deliver distributed training and inference capabilities
Seniority
Principal, hands-on IC with technical leadership (via careerplan.io/jobs/100399715888-principal-software-engineer-ai-compute-platform-at-arm)
