QA Engineer
Core
Designing and maintaining automation frameworks to validate AI/ML pipelines, NLP/LLM models, and data-driven applications.
Role type
Senior AI/ML QA Engineer (Test Automation)
Builds
Scalable automation frameworks for UI, API, and backend systems; test suites for microservices and event-driven architectures.
Domain
Healthcare technology, AI/ML, Large Language Models (LLM), NLP
Deliverable
production ML models | product features
Required skills
Java, Selenium WebDriver, RestAssured, TestNG, API Testing, UI Testing, Microservices Testing, SQL, BigQuery, CI/CD integration, Jenkins, Git, Maven, Prompt validation, Response scoring, Model comparison, JSON data validation
Preferred skills
Python, Mobile testing (Appium), Healthcare domain knowledge, EMR/EHR systems, UMLS/CUI mapping
Technologies
Selenium, RestAssured, TestNG, Jenkins, Maven, Git, Bitbucket, Allure, BigQuery, Pub/Sub, BERT, GPT, QWEN, Gemini
Responsibilities
Design and maintain scalable automation frameworks for UI, API, and backend systems; Perform end-to-end testing of AI/ML pipelines including NLP and LLM applications; Validate LLM outputs using prompt validation, response scoring, and model comparison; Build and execute test strategies for microservices and event-driven architectures; Conduct data validation across systems using SQL/BigQuery; Integrate automated tests into CI/CD pipelines; Analyze defects and identify root causes.
Seniority
Mid-Senior, hands-on IC
