Technical Lead Manager, Prediction, ML Evaluation
Core
Define strategic vision for ML evaluation platforms and infrastructure to validate next-generation deep neural networks for autonomous driving.
Role type
Staff Technical Lead Manager, ML Evaluation
Builds
Evaluation platforms and infrastructure for Waymo Driver autonomous vehicle models
Domain
Autonomous driving / Robotics / Machine Learning
Deliverable
production ML models
Required skills
Engineering management, distributed infrastructure, Python, C++, model evaluation, data science principles, ML deployment orchestration, ML frameworks
Preferred skills
ML evaluation pipelines, computer vision/NLP/robotics model deployment, metrics computation at scale
Technologies
TensorFlow, JAX, Flax, Apache Beam, TF Serving, TorchServe, Kubeflow, SageMaker Pipelines, Vertex AI Pipelines
Responsibilities
Influence strategic direction of foundational infrastructure and evaluation platforms; Collaborate cross-functionally to identify and surface critical signals on model performance; Leverage and scale evaluation platforms to enhance ML developer experience; Manage and mentor a focused team of engineers; Drive best practices and optimize evaluation workflows; Stay at the forefront of emerging technologies in ML evaluation methodologies
Seniority
Staff, hands-on IC with management