Sr Engineer – GenAI Quality Assurance
Core
Designing, testing, and refining complex GenAI applications, primarily in scientific or ML-driven environments, validating and improving AI-assisted workflows across the product lifecycle.
Role type
Senior GenAI Quality Assurance Engineer
Builds
GenAI-powered products (pipelines and AI-assisted workflows) for healthcare R&D
Domain
Healthcare / Generative AI / Machine Learning
Deliverable
production ML models
Required skills
Software engineering with QA ownership, RAG & Graph frameworks, Python, LLM APIs (AWS Bedrock, Azure Foundry, GCP), API testing, data validation, data pipeline testing, version control (Git), scientific computing, ML frameworks, GenAI safety and bias analysis
Preferred skills
Jenkins, Sonarqube, monitoring tools (Prometheus, Grafana), DevOps (Docker), ML Ops, production GenAI deployment at scale
Technologies
AWS Bedrock, Azure Foundry, GCP Gemini, Python, Git, Docker, Jenkins, Sonarqube, Prometheus, Grafana
Responsibilities
Design and implement automated and manual QA strategies for GenAI systems; Build regression tests, generate synthetic test data, build test harnesses and evaluation pipelines; Validate prompt logic, model behavior and evaluation metrics; Execute tests and debug pipelines; Support deployment of GenAI products; Lead system design reviews; Collaborate with data scientists and developers to embed testing checkpoints; Establish testing standards for CI/CD; Conduct code reviews; Document system design decisions and test cases.
Seniority
Senior, hands-on IC
