Senior ML Systems Engineer - AI Evaluation Foundations
Core
Design, implement, and iterate on high-performance evaluation and introspection tools to measure and visualize autonomous vehicle model performance, processing billions of examples to drive rapid innovation.
Role type
Senior IC ML Systems Engineer (AI Evaluation)
Builds
Evaluation signal tools, visualization dashboards, and metrics presentation for the model evaluation loop.
Domain
Autonomous Vehicles / Embodied AI / Data Infrastructure
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, Node.js, React/TypeScript, WebGL/WebGPU, Spark, BigQuery, Kubernetes, high-throughput data streaming, model-based metrics, end-to-end simulation
Preferred skills
Robotics, Autonomous Driving, Master's or PhD in CS, shipping production software in startup-like environments
Technologies
Python, Node.js, React, TypeScript, WebGL, WebGPU, Spark, BigQuery, Kubernetes, Streamlit, Jupyter
Responsibilities
Build and improve evaluation signal and introspection tools; Develop and maintain visualization and metrics presentation; Help teams introspect model behavior; Participate in design and code reviews; Connect offline evaluation with real-world behavior; Design and implement evaluation workflows at scale.
Seniority
Senior, hands-on IC
