Senior Staff Machine Learning Engineer, LLM/VLM Model Architecture & Optimization
Core
Designing and optimizing Large Language Model (LLM) and Vision-Language Model (VLM) architectures for on-device inference in autonomous driving systems.
Role type
Senior Staff Machine Learning Engineer (LLM/VLM Model Architecture & Optimization)
Builds
On-device optimized LLM/VLM models for the Waymo Driver
Domain
Autonomous driving, perception, large-scale foundation models
Deliverable
production ML models
Required skills
Large-scale model development (LLM, VLM), low-latency on-device inference, hardware acceleration, deep learning frameworks (PyTorch, JAX), large-scale model training, safety-critical system modeling
Preferred skills
Large-scale data curation, autonomous vehicle perception/motion planning, top-tier ML conference publications
Technologies
PyTorch, JAX
Responsibilities
Design VLM/LLM model architecture aligned with hardware constraints, optimize model performance for memory/power/compute-constrained environments, collaborate with research/software/hardware/product teams for end-to-end solutions
Seniority
Senior Staff, hands-on IC with strategic direction