Software Engineer, Evaluation
Core
Design and develop evaluation systems, frameworks, and benchmarks to measure and improve the quality of Apple Intelligence AI/ML models.
Role type
Senior IC software engineer (evaluation & benchmarking)
Builds
Evaluation infrastructure, scoring frameworks, and test suites for Apple Intelligence
Domain
AI/ML evaluation, consumer technology
Deliverable
production ML models
Required skills
distributed systems design, RESTful API design, SQL/NoSQL databases, frontend web development (React), benchmark design, experimental analysis
Preferred skills
cross-functional project leadership, independent problem solving, user experience optimization
Technologies
React, JavaScript, RESTful APIs, SQL, NoSQL
Responsibilities
Design and implement evaluation benchmarks and metrics; Develop evaluation methods for real product settings; Research and build reusable evaluation tooling; Execute experiments comparing model capabilities; Collaborate with model training and product teams
Seniority
Senior, hands-on IC
