CareerPlan

Senior Software Quality Engineer

LisbonRemoteFull-time2026-09-09 → 2026-11-16
Hybrid

Core

End-to-end ownership of test automation architecture for backend microservices and native mobile apps, plus quality evaluation for LLM-powered features including hallucination detection and red-teaming.

Role type

Senior Software Quality Engineer (AI/ML focus)

Builds

Scalable automated test suites, API validation layers, and LLM evaluation/red-teaming frameworks

Domain

FinTech, AI/LLM, Mobile & Backend

Deliverable

production ML models

Required skills

TypeScript, Playwright, Appium, REST API testing, LLM evaluation (RAGAS/DeepEval), Red-teaming (DeepTeam/PyRIT), CI/CD integration, AI tools usage

Preferred skills

Fintech/Payment systems, GraphQL/gRPC, LLM observability, Performance testing, Cloud infrastructure (AWS/GCP/Azure)

Technologies

TypeScript, Playwright, Appium, Cucumber, RAGAS, DeepEval, DeepTeam, PyRIT, GitHub Actions, GitLab CI, LangSmith, Langfuse, Arize

Responsibilities

Build and maintain automated test suites for backend and mobile; Validate complex API layers for data integrity; Design and run LLM evaluation suites; Proactively probe LLM systems for safety issues; Integrate test execution into CI/CD pipelines; Collaborate with engineering and AI/ML squads on test design; Support MLOps practices for model versioning and monitoring

Seniority

Senior, hands-on IC