QA Engineer | Barcelona
Core
Design and maintain automated tests for web applications, APIs, and AI-enabled language products, including validating LLM outputs and translation quality.
Role type
Senior IC QA Engineer (AI/LLM focus)
Builds
Automated test frameworks, CI/CD pipelines, and quality validation for AI-generated language outputs
Domain
Language services technology, Generative AI, LLM evaluation
Deliverable
production ML models
Required skills
Playwright, Selenium, C#, Java, RESTful API testing, CI/CD, Azure DevOps, LLM evaluation, risk-based testing
Preferred skills
.NET, SQL, performance testing, AI security testing, multilingual product testing
Technologies
Playwright, Selenium, Azure DevOps, TeamCity, Jira
Responsibilities
Design and maintain automated functional, integration, regression, and API tests; Build scalable test automation frameworks; Integrate tests into CI/CD pipelines; Perform exploratory, cross-browser, and database testing; Validate AI-generated language outputs for fluency and meaning; Design repeatable AI test scenarios and evaluation datasets; Identify and document AI-specific failures like hallucinations or bias; Use AI assistants for test-case design while verifying outputs; Collaborate with developers and product teams on release readiness.
Seniority
Senior, hands-on IC