QA Engineer (AI & Feature Testing)
Core
Senior QA Engineer validating AI-powered and traditional features for a personal finance platform, focusing on testing probabilistic AI/LLM outputs alongside deterministic software.
Role type
Senior IC QA Engineer (AI & Feature Testing)
Builds
Web, mobile, and API features for a personal finance platform
Domain
Fintech / AI & Machine Learning
Deliverable
production ML models
Required skills
Playwright, AI/LLM feature testing, eval-based testing, deterministic testing, manual feature testing, integration testing, regression testing, performance/load testing, UAT, browser DevTools, log monitoring, Jira, Confluence, test management systems
Preferred skills
HTML proxy tools (Charles Proxy, Fiddler), Xcode logs, ADB logs, financial services domain experience
Technologies
Playwright, iOS, Android, Jira, Confluence
Responsibilities
Plan and execute test cases for AI and traditional features; Analyze functional requirements and AI model behavior; Create test plans and scripts; Perform manual testing and verify bug fixes; Document defect reports and AI model anomalies; Develop QA practices for emerging AI technologies; Partner with functional teams and engineers
Seniority
Senior, hands-on IC