Senior Manager, Engineering - AI Validation
Core
Lead the AI Validation function to test, evaluate, and govern AI models, LLMs, RAG pipelines, and agentic capabilities for software-defined vehicles and cloud platforms.
Role type
Senior Engineering Manager, AI Validation
Builds
Scalable test strategy, evaluation frameworks, governance mechanisms, and AI quality platforms for automotive and cloud AI systems.
Domain
Automotive software-defined vehicles, Cloud AI, LLMs, RAG, Agentic AI
Deliverable
production ML models | product features | dashboards & analysis
Required skills
AI/ML system development and deployment, MLOps, LLM/RAG architecture, agentic AI frameworks, scalable evaluation framework design, hybrid evaluation methodologies (deterministic + LLM-as-a-Judge), RAG evaluation (RAGAS), AI governance and safety compliance, Python, Linux, test frameworks (PyTest, Playwright), CI/CD tools (Jenkins, JIRA)
Preferred skills
Experience in safety-critical/regulated industries (automotive, aerospace, medical), building enterprise-grade AI test platforms, standardizing AI testing practices, implementing auditability and policy enforcement
Technologies
LangGraph, RAGAS, PyTest, Playwright, Behave, Jenkins, JIRA, Python, Linux
Responsibilities
Define and drive AI validation strategy across embedded, cloud, and LLM/RAG environments; Lead, hire, and mentor the AI Validation organization; Architect evaluation harnesses for RAG and agentic systems; Evaluate and optimize AI validation technologies; Establish AI governance and Responsible AI practices; Act as quality gatekeeper for AI-enabled releases; Collaborate on emerging AI capabilities and standardize practices
Seniority
Senior, hands-on IC with management responsibilities
