Software Engineer II, Autonomy Evaluation & Metrics Platform
Core
Build backend services, Python libraries, and data pipelines to create reproducible measurements and comparisons for ML models behind autonomous driving systems.
Role type
Senior IC backend engineer (metrics platform)
Builds
Scalable metric-processing pipelines, APIs, and evaluation workflows for simulation and real-world vehicle data
Domain
Autonomous vehicles / Machine Learning / Data Engineering
Deliverable
production ML models
Required skills
Python, SQL, backend services, data pipelines, API design, cloud services, containers, CI/CD, statistical reasoning
Preferred skills
PyTorch, distributed data processing (Spark/Databricks), AWS, Docker, GitLab CI, autonomy/robotics experience
Technologies
Python, SQL, PyTorch, Spark, Databricks, Delta Lake, AWS, Docker, GitLab CI
Responsibilities
Build and test services, APIs, and libraries for metric registration and retrieval; Implement scalable metric-processing pipelines with safe retries and backfills; Capture code, metric, model, dataset, and scenario versions for reproducibility; Build tools for comparing model versions and exploring results by scenario; Work with model developers to run evaluation experiments and investigate failure patterns; Integrate metrics into evaluation workflows, CI regression checks, and release scorecards; Debug production issues and improve automated tests and observability.
Seniority
Mid-level (2+ years), hands-on IC
