Senior Software Quality Engineer - AI
Core
Design and implement comprehensive testing strategies for backend infrastructure and Generative AI features powering agentic applications.
Role type
Senior Software Quality Engineer (AI/ML)
Builds
Automated testing frameworks, evaluation datasets, and quality gates for AI/ML models and backend services.
Domain
Enterprise data integration and Generative AI
Deliverable
production ML models | product features
Required skills
Automated testing frameworks, LLM/SLM model testing, prompt/output validation, behavioral assessment of agentic workflows, quality metrics development, synthetic test data creation, observability and monitoring, performance/load testing, cloud/containerized testing
Preferred skills
AI evaluation tools, structured logging, metrics collection, tracing, test documentation, quality reports
Technologies
Pytest, Playwright, unittest, integration testing libraries
Responsibilities
Design and execute test plans for backend services, APIs, and microservices; Develop automated testing frameworks; Build end-to-end test suites validating backend-AI-agent-database integration; Design automated evaluation frameworks for Generative AI features; Create curated evaluation datasets and synthetic test data; Establish observability and monitoring requirements; Implement performance, load, and reliability testing.
Seniority
Senior, hands-on IC