Staff Research Engineer, Autonomy VLM
Core
Define and deliver the overarching Vision-Language Model (VLM) strategy for autonomous vehicles, including training, optimization, deployment, and solving challenges like automated data mining and edge-case detection.
Role type
Staff Research Engineer (Autonomy VLM)
Builds
VLM-driven solutions for autonomous vehicle perception, planning, and data mining pipelines.
Domain
Autonomous Vehicles / Computer Vision / Machine Learning
Deliverable
production ML models
Required skills
VLM model training and fine-tuning, automated data mining, zero/few-shot classification, system engineering, root-cause analysis
Preferred skills
Auto Prompt Optimization, spatial grounding, onboard edge deployment, quantization techniques, complex behavior reasoning
Technologies
Python, LoRA, QLoRA, RL alignment, TensorRT, PTQ, QAT
Responsibilities
Define and execute the VLM model delivery roadmap; design strategies for automated data mining and anomaly detection; establish evaluation benchmarks and optimize model performance; partner with cross-functional autonomy teams to translate requirements into ML deliverables.
Seniority
Staff, strategy & hands-on IC