CareerPlanSign in

Software Engineer, Distributed Systems

💼 Full-time🗓 2026-03-13 → 2026-09-25

Core

Building large-scale distributed computing platforms for AI workload orchestration, scheduling, and GPU autoscaling.

Role type

Senior IC distributed systems engineer

Builds

Core Python/Rust platform for request routing, AI workload orchestration, scheduling, GPU autoscaling, and large-scale file storage

Domain

Generative AI infrastructure / Distributed systems

Deliverable

production ML models

Required skills

Python, Rust, distributed systems fundamentals, consensus algorithms, scheduling, fault tolerance, capacity planning, computational complexity, memory allocation, observability, high-performance systems programming, async runtimes, zero-copy, memory-safe concurrency, networking fundamentals, GPU workload scheduling

Preferred skills

AI/ML inference or training infrastructure, multi-tenant compute platforms

Technologies

Python, Rust

Responsibilities

Build core platform components including request routing, orchestration, scheduling, and GPU autoscaling; Produce forward designs for platform evolution to scale 100x traffic; Profile and tune low-level CPU and memory performance; Leverage AI to automate system building tasks

Seniority

Senior, hands-on IC

Sourced via ashby · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.