Software Engineer, ML Developer Experience
Core
Building the experience layer of the Anyscale platform (CLI, SDKs, APIs, UI) to help developers and coding agents discover, configure, run, observe, debug, and productionize AI workloads on Ray.
Role type
Senior individual-contributor software engineer (ML Developer Experience)
Builds
Developer tooling, MLOps capabilities, agent-first CLI/SDK/API/MCP surfaces, Workspaces stack, and backend services for the AI development lifecycle.
Domain
Distributed machine learning infrastructure and developer tooling
Deliverable
production ML models | product features
Required skills
system design, algorithms, data structures, building highly available services, modern ML tooling (PyTorch, MLflow), product judgment, shipping developer-facing tools
Preferred skills
open-source project maintenance, operating ML infrastructure in production, building highly available serving systems, Ray experience
Technologies
Ray, PyTorch, MLflow, OpenTelemetry, OpenAI-compatible APIs
Responsibilities
Build next-gen developer tooling and MLOps capabilities; Develop agent-first CLI and cohesive SDK/API/MCP surfaces; Work across the Anyscale Workspaces stack; Build frameworks for the AI development lifecycle; Build paths from trained models to production endpoints; Surface observability across interfaces; Design open integrations and backend services; Collaborate with users and field teams to scope and ship products.
Seniority
Senior, hands-on IC
