Senior Research Scientist, Perception
Core
Research and develop state-of-the-art Multimodal LLMs and World models for 3D Perception using Camera, LiDAR, and Radar sensor data to enable autonomous driving.
Role type
Senior Research Scientist (Perception/AI Foundations)
Builds
Multimodal LLMs, World models, Encoders, and Sensor understanding models for the Waymo Driver.
Domain
Autonomous driving, Computer Vision, Reinforcement Learning, Foundation Models
Deliverable
production ML models
Required skills
Multimodal LLMs, World models, 3D Perception, Reinforcement Learning, Foundation Models, Distributed training (Data parallel, FSDP), Model evaluation frameworks, Sensor data analysis (LiDAR/Camera/Radar), Academic publishing
Preferred skills
On-policy Reinforcement Learning, Human preference alignment, Generative models (diffusion/autoregressive), 3D/Video generation, Top-tier conference publications (NeurIPS/ICLR/ICRA)
Technologies
LLMs, World models, FSDP, Data parallel, Diffusion models, Autoregressive models
Responsibilities
Research and develop Multimodal LLMs and World models for 3D Perception; Integrate emerging AI research into Waymo's Encoders and Sensor models; Develop scalable data pipelines for Training & Eval; Design evaluation frameworks for perception models; Analyze model behaviors (scaling efficacy, architecture ablations); Design Perception Modeling solutions for LiDAR/Camera/Radar data; Communicate research findings via technical reports or publications.
Seniority
Senior, hands-on IC