Sr Engineering Program Manager, Apple Intelligence Evaluations
Core
Own evaluation plans for Apple's foundation models or AI features, ensuring quality for over 1 billion customers.
Role type
Senior Engineering Program Manager (AI/ML)
Builds
Evaluation plans, methodologies, and tooling for foundation models and AI features
Domain
Consumer technology, Artificial Intelligence, Machine Learning
Deliverable
production ML models
Required skills
Program management, cross-functional leadership, data-driven decision-making, risk management, stakeholder alignment, technical communication
Preferred skills
Generative AI program management, LLM evaluation practices, product data analysis, AI feature shipping, ML system understanding
Technologies
Foundation models, Large Language Models (LLMs), annotation operations
Responsibilities
Define evaluation requirements and methodologies; manage annotation and data collection operations; synthesize technical complexity for executive leadership; drive complex workstreams with clear dependencies
Seniority
Senior, hands-on IC
