Analyst, QA
Core
Designing and implementing automated test frameworks and AI-based reasoning tests for Large Language Model (LLM) applications to ensure data correctness and quality.
Role type
Senior QA Automation Engineer (LLM/AI)
Builds
Automated test frameworks and validation tools for LLM-based applications
Domain
Financial Technology (Fintech) / Artificial Intelligence
Deliverable
production ML models
Required skills
Python, QA automation, LLM testing, Agentic AI tools, prompt engineering, test framework design
Preferred skills
Fixed income markets knowledge, financial instruments knowledge
Technologies
Python, LLM frameworks, Agentic AI tools
Responsibilities
Implement automated test frameworks for LLM applications, Develop AI-based reasoning tests for LLM output correctness, Improve testing methodologies for LLM applications, Design and optimize prompts for LLM applications