Systems Engineer, World Model Evaluation - Autonomous Vehicles
Core
Develop requirements, metrics, and evaluations to measure the accuracy of autonomous vehicle world models, connecting perception and map-fusion performance to driving behavior and safety.
Role type
Senior Systems Engineer (Autonomous Vehicle Evaluation)
Builds
Evaluation datasets, reproducible analysis pipelines, automated triage tools, and dashboards for release readiness.
Domain
Autonomous Vehicles / AI Safety / Systems Engineering
Deliverable
production ML models
Required skills
Systems engineering, quantitative systems analysis, verification and validation, statistical analysis, experiment design, Python, SQL, distributed data-processing frameworks, object storage, SQL-based data platforms, C++
Preferred skills
Perception/map-fusion evaluation, data science, orchestration frameworks (Temporal), VLM/LLM validation, automotive functional safety, automated testing
Technologies
Python, SQL, C++, Temporal, VLMs, LLMs
Responsibilities
Translate driving-feature needs and safety analysis into world-model requirements and error budgets; investigate real-world failure modes and develop metrics/scenarios; build and validate evaluators connecting world-model errors to vehicle behavior; partner with data teams to define evaluation datasets and labeling guidelines; develop reproducible analysis and automated triage using on-road data and simulation; turn results into decisions through evaluation tools and dashboards.
Seniority
Senior, hands-on IC