CareerPlan

Staff Research Engineer, Autonomy VLM

Palo Alto, CaliforniaFull-time$228k–$285k2026-07-17 → 2026-11-20
Based in United States

Core

Define and deliver the overarching Vision-Language Model (VLM) strategy for autonomous vehicles, including training, optimization, deployment, and solving challenges like automated data mining and edge-case detection.

Role type

Staff Research Engineer (Autonomy VLM)

Builds

VLM-driven solutions for autonomous vehicle perception, planning, and data mining pipelines.

Domain

Autonomous Vehicles / Computer Vision / Machine Learning

Deliverable

production ML models

Required skills

VLM model training and fine-tuning, automated data mining, zero/few-shot classification, system engineering, root-cause analysis

Preferred skills

Auto Prompt Optimization, spatial grounding, onboard edge deployment, quantization techniques, complex behavior reasoning

Technologies

Python, LoRA, QLoRA, RL alignment, TensorRT, PTQ, QAT

Responsibilities

Define and execute the VLM model delivery roadmap; design strategies for automated data mining and anomaly detection; establish evaluation benchmarks and optimize model performance; partner with cross-functional autonomy teams to translate requirements into ML deliverables.

Seniority

Staff, strategy & hands-on IC