Quality Engineer, Employee Experience Engineering
Core
Engineering Enablement engineer ensuring quality and reliability of Apple's internal AI and productivity applications by acting as a bridge between users and engineering teams.
Role type
Quality Engineer (AI/ML focus)
Builds
Automated evaluation pipelines, LLM-as-a-judge frameworks, and quality monitoring systems for AI models.
Domain
Enterprise productivity tools and Generative AI
Deliverable
production ML models
Required skills
Software development lifecycle, AI application testing, prompt engineering, test automation, data validation, CI/CD integration, alerting and monitoring, stakeholder collaboration
Preferred skills
macOS/iOS platform testing, Swift/SwUIUI development, Jira/Radar issue tracking
Technologies
XCTest, XCUITest, Selenium, Playwright, LLM-as-a-judge, CI/CD pipelines
Responsibilities
Drive quality engineering through internal testing including User Acceptance Testing (UAT); Design and generate realistic synthetic datasets including adversarial and edge-case scenarios; Systematically review AI-generated outputs against evaluation rubrics to identify hallucinations and unsupported claims; Analyse evaluation data to identify failure patterns and quality trends; Generate actionable insights to prioritize model retraining and prompt refinement; Design and build end-to-end automated evaluation pipelines integrating into CI/CD; Implement alerting and monitoring mechanisms for real-time quality drop detection; Partner with ML engineers and product teams to align evaluation standards; Maintain technical documentation and troubleshoot production issues.
Seniority
Mid-level, hands-on IC
