Senior Test Engineer - Metrics Quality
Core
Own the quality and acceptance of metrics used for autonomous driving software release decisions, ensuring they are trusted before decisions are made.
Role type
Senior Test Engineer (Metrics Quality)
Builds
A trusted case space and regression cycle for metrics that determine software merge/revert decisions.
Domain
Autonomous driving software / Data quality
Deliverable
production ML models
Required skills
Python, SQL, statistical literacy, product thinking, LLM usage, metric validation, test data generation, regression testing
Preferred skills
Autonomous vehicles, robotics, ML evaluation, ClickHouse, A/B testing infrastructure, annotation task design, US road rules knowledge
Responsibilities
Own acceptance of new and changed metrics; build the case space for each metric; hunt silent failures where metrics return nothing; read implementation against the case space; build necessary test data; make the case for fixes with concrete examples; think like the people who read the numbers; own the release cycle for metrics including regression testing.
Seniority
Senior, hands-on IC