Sr Test Engineer
Core
Design test strategies and build Python testing frameworks for agentic AI systems, LLM-driven workflows, and non-deterministic behaviors to ensure reliability and safety.
Role type
Senior IC Quality Engineer (AI/ML)
Builds
Genesys Cloud Copilot (agentic AI platform)
Domain
AI/ML, Customer Experience (CX), SaaS
Deliverable
production ML models
Required skills
Python, test strategy design, CI/CD automation, API/service testing, LLM/AI agent testing, project ownership, stakeholder communication
Preferred skills
Non-deterministic system testing, AI evaluation frameworks (DeepEval, Ragas, LangSmith), performance/load testing, cloud platforms (AWS), containerized environments
Technologies
Python, pytest, MCP, LLMs, AWS, DeepEval, Ragas, LangSmith, Locust, k6, JMeter
Responsibilities
Design test strategies for agentic AI systems and multi-step workflows; Build and maintain scalable Python test frameworks; Develop approaches for testing non-deterministic behavior; Contribute to Test Architecture initiatives; Drive adoption of AI SDLC practices; Own testing projects end to end.
Seniority
Senior, hands-on IC
