Senior Software Engineer, Distributed Compute System
Core
Build and scale large-scale computing infrastructure in cloud/data centers to support machine learning data pipelines, simulation, and log processing for autonomous driving.
Role type
Senior IC distributed systems engineer
Builds
Scalable frameworks (BATES) and APIs for orchestrating large-scale workloads in cloud and on-premise clusters
Domain
Cloud infrastructure / Distributed systems / Autonomous driving
Deliverable
infrastructure
Required skills
Kubernetes, large-scale distributed applications, system design, Linux (CPU scheduler, memory management, file systems), workflow management tools, data analysis, real-time monitoring (Prometheus), CI/CD
Preferred skills
Database technologies (Redis, SQL, NoSQL), pub/sub systems, hyperscalers (GCP), map-reduce frameworks (Airflow, Ray, Dataflow)
Responsibilities
Design and develop scalable, reliable frameworks; Collaborate with application teams to provide robust tools and APIs; Optimize workload efficiency and turnaround time
Seniority
Senior, hands-on IC