CareerPlanGet AI match score →

Ai Focused Qa Engineer Manual Testing Startup Ai Products

💼 Full-time🗓 2026-07-31

Core

Manual QA Engineer validating AI-generated content, complex workflows, and data accuracy for student-focused AI tools.

Role type

Manual QA Engineer (AI-focused)

Builds

AI-powered academic and career planning tools for students

Domain

EdTech / AI / Content Platforms

Deliverable

production ML models | product features

Required skills

manual testing, test case design, edge case identification, analytical thinking, data validation, exploratory testing

Preferred skills

LLM/prompt system exposure, API testing concepts, SQL, data validation

Technologies

web-based AI products, education/career datasets

Responsibilities

Design and execute manual test cases for web-based AI products, Test complex user flows across multiple product modules, Evaluate AI-generated outputs for accuracy, relevance, tone, and logic, Identify hallucinations, inconsistencies, and UX issues in AI responses, Validate structured and unstructured data quality, Perform exploratory testing and edge-case discovery

Seniority

Individual Contributor

Rewrite
## About the Company Kyros.ai builds AI-powered tools that support students in their academic and career journeys—covering essays, extracurriculars, and personalized pathways. Our platform relies heavily on AI agents, content extraction, and dynamic user flows, which makes quality a core product function—not just a testing layer. We are a small, fast-moving team focused on building useful, trustworthy AI experiences for students. ## About the Role We're looking for a QA Engineer with strong manual testing skills and curiosity about AI systems. This role focuses on validating AI-generated content, complex workflows, and data accuracy across multiple product modules. You will not just execute test cases—you will help define what "correct" and "high-quality" means in AI-driven features. This is a high-ownership role in a startup environment. ## Responsibilities - Design and execute manual test cases for web-based AI products - Test complex user flows across multiple product modules - Evaluate AI-generated outputs for accuracy, relevance, tone, and logic - Identify hallucinations, inconsistencies, and UX issues in AI responses - Validate structured and unstructured data quality (education/career datasets) - Perform exploratory testing and edge-case discovery - Collaborate closely with product, engineering, and AI teams - Contribute to improving QA processes and test coverage ## Required Skills - Strong experience in manual QA testing - Ability to design structured test cases and identify edge cases - Experience testing content-heavy or dynamic systems - Strong analytical thinking and attention to detail - Clear communication skills (bug reports, structured feedback) - Ability to work with ambiguous requirements ## Nice to Have - Exposure to AI tools, LLMs, or prompt-based systems - Basic understanding of API testing or automation concepts - Experience in EdTech, HRTech, or content platforms - Familiarity with data validation or SQL - Interest in AI evaluation / model behavior analysis ## What Makes You Successful in This Role You will thrive here if you: - Think critically beyond test cases - Care about user trust in AI outputs - Enjoy investigating "why something is wrong" - Are comfortable working in fast-changing product environments - Take ownership instead of waiting for instructions
Sourced via wellfound · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.
Apply on Wellfound ↗