Senior Software Quality Engineer
Core
End-to-end ownership of test automation architecture for backend microservices and native mobile apps, plus quality evaluation for LLM-powered features including hallucination detection and red-teaming.
Role type
Senior Software Quality Engineer (AI/ML focus)
Builds
Scalable automated test suites, API validation layers, and LLM evaluation/red-teaming frameworks
Domain
FinTech, AI/LLM, Mobile & Backend
Deliverable
production ML models
Required skills
TypeScript, Playwright, Appium, REST API testing, LLM evaluation (RAGAS/DeepEval), Red-teaming (DeepTeam/PyRIT), CI/CD integration, AI tools usage
Preferred skills
Fintech/Payment systems, GraphQL/gRPC, LLM observability, Performance testing, Cloud infrastructure (AWS/GCP/Azure)
Technologies
TypeScript, Playwright, Appium, Cucumber, RAGAS, DeepEval, DeepTeam, PyRIT, GitHub Actions, GitLab CI, LangSmith, Langfuse, Arize
Responsibilities
Build and maintain automated test suites for backend and mobile; Validate complex API layers for data integrity; Design and run LLM evaluation suites; Proactively probe LLM systems for safety issues; Integrate test execution into CI/CD pipelines; Collaborate with engineering and AI/ML squads on test design; Support MLOps practices for model versioning and monitoring
Seniority
Senior, hands-on IC