Senior Software Development Test Engineer - AI
Core
Building confidence in the quality, correctness, and reliability of machine learning models and AI agents powering the Automotive Retail Cloud.
Role type
Senior AI Software Development Engineer in Test (SDET)
Builds
Machine learning models, AI agents, and AI-powered features for the automotive retail ecosystem.
Domain
Automotive retail technology and machine learning.
Deliverable
production ML models
Required skills
Python, Java, test automation frameworks, ML concepts (training/inference/evaluation metrics), LLM/agent concepts (prompting/RAG/embeddings), CI/CD, API/integration testing, root cause analysis, analytical debugging.
Preferred skills
MLflow, Weights & Biases, LangSmith, Ragas, DeepEval, cloud platforms (AWS/GCP/Azure), Docker, Kubernetes, model observability, agentic systems testing.
Technologies
Python, Java, MLflow, Weights & Biases, LangSmith, Ragas, DeepEval, AWS, GCP, Azure, Docker, Kubernetes.
Responsibilities
Design and implement automated testing frameworks for model inference, prompt pipelines, and agentic workflows; Validate model correctness, accuracy, latency, and behavioral consistency; Create and curate evaluation datasets and ground-truth sets; Build LLM-as-judge and automated scoring pipelines; Use AI/LLMs to generate test cases, synthetic data, and automation scaffolding; Drive root cause analysis for production model issues; Define quality metrics, guardrails, and automated monitoring.
Seniority
Senior, hands-on IC
