AIML - Machine Learning Engineer, Evaluation - Responsible AI and Safety
Core
Lead a team to assess, quantify, and improve the safety and inclusivity of Apple's Generative-AI powered features and products, specifically large language models and multimodal systems.
Role type
Senior Engineering Manager (Responsible AI Evaluation)
Builds
Operationalized safety evaluation frameworks, datasets, and scalable insights for generative AI products
Domain
Generative AI, Responsible AI, Large Language Models, Multimodal Systems
Deliverable
production ML models
Required skills
Team leadership, metric development for safety/fairness, dataset design, human-in-the-loop evaluation, data pipeline implementation, cross-functional stakeholder management, Python, data analysis
Preferred skills
Responsible AI experience, fairness/bias research, compliance/regulatory knowledge, multimodal model experience, scientific publication track record
Technologies
Python, Pandas, LLM-Judges, human annotation tools
Responsibilities
Develop metrics for safety and fairness risks, design datasets using human and synthetic generation, implement data pipelines for safety evaluations, automate manual workflows, distill findings for product engineering and policy teams
Seniority
Senior, hands-on IC with management responsibilities
