Quality Assurance (QA) - Lead - MiDAS
Core
Develop AI quality evaluation frameworks for GenAI solutions and architect hybrid test automation suites for deterministic and probabilistic outputs.
Role type
Lead QA Engineer (GenAI & Automation)
Builds
Automated evaluation frameworks, E2E UI/API test suites, and CI/CD quality gates for vehicle software.
Domain
Automotive software engineering, Generative AI, Test Automation
Deliverable
production ML models | product features
Required skills
Python, Pytest, Playwright, JMeter, GitHub Actions/Workflows, LLM-as-a-Judge frameworks, RAG system validation, probabilistic quality monitoring
Preferred skills
Langfuse, vector database validation, upskilling in automated LLM metrics
Technologies
Python, Pytest, Playwright, JMeter, GitHub Actions, Langfuse
Responsibilities
Develop evaluation frameworks for GenAI solutions focusing on Faithfulness, Relevancy, and Hallucination detection; Architect a dual-layered automation suite for deterministic and probabilistic testing; Embed automated quality checks into GitHub Workflows for CI/CD; Lead JMeter-based performance testing.
Seniority
Senior, hands-on IC