Team Lead
Core
Design and execute test plans for AI/LLM-based applications, validating model outputs and improving quality through automated testing frameworks.
Role type
Senior IC QA Lead (AI/LLM)
Builds
Automated testing frameworks for AI workflows and output validation
Domain
Artificial Intelligence / Large Language Models
Deliverable
production ML models
Required skills
AI/LLM testing, prompt engineering, Python, Java, automation tools, model validation, defect tracking, performance testing
Preferred skills
NLP applications, generative AI platforms, AI ethics, responsible AI testing practices
Responsibilities
Design and execute test plans and test cases for AI/LLM-based applications, Perform functional, regression, and performance testing for AI models and LLM integrations, Validate prompt engineering techniques to ensure accurate and relevant model outputs, Identify, track, and report defects in AI behavior and LLM responses, Collaborate with AI/ML engineers to analyze model limitations and improve quality, Develop automated testing frameworks for AI workflows and output validation
Seniority
Senior, hands-on IC