CareerPlan
Atlanta, GeorgiaFull-time2026-03-03 → 2026-10-28

Core

QA Engineer specializing in testing LLM-based software, creating automated tests, and improving prompts for AI applications.

Role type

QA automation engineer (LLM/AI)

Builds

Automated test frameworks and AI-driven validation tools for LLM applications

Domain

Artificial Intelligence / Large Language Models

Deliverable

production ML models

Required skills

Python, automated test frameworks, Agentic AI tools, prompt engineering, LLM testing methodologies

Preferred skills

fixed income markets knowledge, financial instruments knowledge

Technologies

Python, Agentic AI tools

Responsibilities

Implement automated test frameworks for LLM applications, create automated tests using AI for reasoning on LLM output correctness, improve testing methodologies for LLM apps, design and improve prompts for LLM applications

Seniority

Mid-level, hands-on IC