Lead Software Engineer in Test
Core
Lead quality engineering initiatives for Agentic AI systems, including LLM workflows, RAG pipelines, and autonomous agents, while building scalable automation frameworks.
Role type
Lead Software Engineer in Test (SDET/SET) specializing in AI/Agentic AI
Builds
Scalable automation frameworks, regression test suites, and validation strategies for AI-driven applications
Domain
Healthcare technology, Artificial Intelligence, Agentic AI, Cloud-native systems
Deliverable
production ML models
Required skills
Automation framework development (JavaScript/TypeScript, Java), AI agent testing (LangGraph, CrewAI, AutoGen), API and backend integration testing, CI/CD pipeline integration, Cloud-native environments (Azure, AWS, GCP, Docker, Kubernetes), Distributed system testing, Test environment design, Mentorship
Preferred skills
AI observability tools, RAG pipeline validation, Vector databases, HIPAA compliance knowledge, Event-driven architectures, Azure DevOps/GitHub Actions
Technologies
Playwright, Cypress, Postman, K6, LangGraph, CrewAI, AutoGen, Semantic Kernel, Azure, AWS, GCP, Docker, Kubernetes, SQL Server
Responsibilities
Design and maintain scalable automation frameworks and regression test suites across UI, API, backend, and AI-driven applications; Validate complex AI agent behaviors such as multi-agent coordination, tool calling, and prompt chaining; Develop and execute functional, integration, regression, and performance testing strategies; Mentor QA engineers and contribute to scalable QA standards; Lead validation efforts for AI workflow resiliency and distributed system reliability
Seniority
Senior, hands-on IC with leadership responsibilities
