Senior Software Engineer, Training Efficiency
Core
Design and improve distributed input data pipelines to optimize runtime efficiency for large-scale ML training workloads in autonomous driving.
Role type
Senior Software Engineer, ML Infrastructure
Builds
Scalable, reliable data processing systems for Waymo Driver model training
Domain
Autonomous driving / Machine Learning Infrastructure
Deliverable
infrastructure
Required skills
Distributed systems design, ML data pipeline optimization, Python, C++, TensorFlow, JAX, Grain, tf.data service, performance profiling
Preferred skills
ML Pathways, distributed dataflow frameworks
Technologies
ML Pathways, Grain, JAX, TensorFlow, tf.data service
Responsibilities
Design and improve distributed input data pipelines for large-scale ML training workloads; Collaborate with researchers and ML engineers to resolve bottlenecks in data pipeline performance; Improve runtime goodput of ML training workload; Implement and maintain advanced ML infrastructure tools; Evaluate and integrate modern technologies to enhance performance and scalability; Promote best practices for distributed systems architecture
Seniority
Senior, hands-on IC
