GenAI QE Strategy Lead
Core
Lead Quality Engineering strategy and automation for GenAI development projects, focusing on LLM integration, prompt engineering, and RAG systems within a CI/CD pipeline.
Role type
Senior IC GenAI Quality Engineering Strategy Lead
Builds
Scalable testing frameworks and automation tools for GenAI applications in cloud environments
Domain
Financial services / Generative AI / Software Testing
Deliverable
production ML models | infrastructure
Required skills
GenAI testing and evaluation, Prompt engineering frameworks, RAG systems testing, Python, AI evaluation tools (LangChain), Cloud architecture (AWS/Azure/GCP), STLC, CI/CD pipelines, API testing, SQL/Snowflake, Test automation, LLM integration
Preferred skills
Regulatory reporting experience, Financial services industry knowledge, Defect management tools (QTest), Unix environment
Technologies
Python, LangChain, AWS, Azure, GCP, SQL, Snowflake, Selenium, QTest
Responsibilities
Design testing frameworks for CI/CD pipelines, Conduct testing and evaluation of GenAI models and RAG systems, Collaborate with Dev and BA leads on agile sprints, Review and modify programming systems for large-scale applications, Ensure operating efficiency of application systems, Analyze organizational needs for application system development
