Senior Software Engineer, ML Evaluation Infra and Efficiency
Core
Design and build distributed evaluation platforms to train, evaluate, and improve pre-trained ML models for Waymo's autonomous driving software.
Role type
Senior Software Engineer, ML Evaluation Infra and Efficiency
Builds
Large-scale distributed evaluation platforms for Perception and Planning models
Domain
Autonomous driving / Machine Learning Infrastructure
Deliverable
production ML models
Required skills
Distributed systems design, ML efficiency optimization, Python, C++, Profiling tools, TensorFlow, JAX, XLA
Preferred skills
Large-scale evaluation platforms for LLMs
Technologies
ML Pathways, JAX, Flume, TensorFlow
Responsibilities
Design and build distributed evaluation platforms for large-scale ML evaluation workloads; Profile evaluation platforms and implement optimizations to improve inference speed and resource utilization; Collaborate with ML engineers to improve DevX of evaluation infrastructure; Improve runtime goodput of ML inference workload and efficiency of metrics computations; Implement and maintain advanced ML infrastructure tools
Seniority
Senior, hands-on IC