Storage AI Expert
Core
Design, develop, and execute test plans for multi-agent systems and AI-powered products, ensuring quality, reliability, and safety of LLMs and intelligent automation.
Role type
Senior QA Engineer (Generative AI)
Builds
AI-powered cloud platform features (Green Lake) and multi-agent systems
Domain
Cloud computing, Generative AI, Storage
Deliverable
production ML models
Required skills
Generative AI testing, multi-agent system testing, LLM evaluation, prompt testing, red-teaming, test automation, API testing, Python, JavaScript, AI safety testing, MCP ecosystem, multi-agent orchestration platforms
Preferred skills
None stated
Technologies
Selenium, Playwright, Cypress, Postman, Jira, Azure DevOps, LangGraph, CrewAI, AutoGen, OpenAI Agents SDK
Responsibilities
Design and execute test plans for multi-agent systems; Evaluate model behavior across real-world scenarios and adversarial inputs; Test prompt flows, agent behaviors, and generative outputs; Identify and document issues related to hallucinations, bias, and unsafe content; Build automated test frameworks for regression testing; Conduct manual exploratory testing for new AI features; Create evaluation metrics and quality rubrics; Monitor production issues and drive quality improvements; Perform risk assessments for AI safety and compliance.
Seniority
Senior, hands-on IC