Principal Quality Assurance Engineer – Generative AI & LLM Platforms
Core
Own quality strategy and hands-on validation for enterprise products built with Generative AI, large language models, distributed systems, and modern React-based user interfaces.
Role type
Senior Quality Assurance Engineer (Generative AI & LLM Platforms)
Builds
Enterprise products integrating GenAI, LLMs, distributed systems, and React UIs
Domain
Generative AI, Large Language Models, Distributed Systems, Cloud Infrastructure
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Risk-based test strategy design, AI model evaluation (groundedness, safety, hallucination), React UI testing, AWS distributed systems testing, Python/pytest automation, CI/CD integration, Chaos testing, Adversarial validation, Networking protocols (BGP, MPLS, VXLAN), Observability tooling
Preferred skills
LangSmith/LangGraph/Langfuse experience, MCP integration, Agent evaluation, Prompt regression, OWASP threat modeling, Multi-tenant architecture testing
Technologies
Python, pytest, React, AWS, JMeter, SoapUI, Postman, Ixia, Spirent, Datadog, LangSmith, LangGraph, Langfuse, gRPC, SNMP, LLDP
Responsibilities
Define risk-based test strategies and release criteria across AI, UI, API, and cloud layers; Evaluate model quality metrics including safety, privacy, and robustness; Validate React interfaces, accessibility, and security; Test AWS deployments, scaling, and disaster recovery; Build reusable Python/pytest frameworks for performance and E2E testing; Use telemetry and user feedback to detect regressions; Mentor engineers and promote shared quality ownership
Seniority
Senior, hands-on IC with technical leadership
