CareerPlanSign in

QA & AI Engineer

South Africa🌐 Remote💼 Full-time🗓 2026-05-30 → 2026-08-11

Core

Monitoring, optimizing, and testing AI agents and automated systems to ensure accuracy, compliance, and performance.

Role type

QA & AI Engineer

Builds

AI agents, automated testing scripts, and platform updates

Domain

AI systems, automation, customer support technology

Deliverable

production ML models | product features

Required skills

AI agent platform familiarity, Large Language Models (LLMs) understanding, CRM system experience, chatbot platform experience, email management system experience, reporting tool usage, attention to detail, system behavior analysis, workflow translation

Preferred skills

Metabase familiarity, South African languages

Technologies

AI agent platforms, CRM systems, chatbot platforms, email management systems, Metabase

Responsibilities

Monitor AI agent interactions for accuracy and compliance, update AI agents with new information, test new AI agents prior to deployment, resolve logic gaps and AI-related errors, verify automated testing ticket descriptions, conduct internal system testing, create and maintain system documentation, analyze AI performance metrics and QA audit outcomes

Seniority

Mid-level, hands-on IC

Sourced via adzuna · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.