AIML - Sr Machine Learning Platform Engineer, Evaluation
Core
Design and build evaluation infrastructure, benchmarks, and simulation environments to refine Apple's foundation models and agents.
Role type
Senior IC machine learning platform engineer (evaluation)
Builds
Evaluation systems, LLM judges, reward models, prompt optimization pipelines, and simulation environments
Domain
Artificial Intelligence / Machine Learning / Foundation Models
Deliverable
production ML models
Required skills
Machine learning, distributed systems, LLM evaluation, reward modeling, prompt optimization, simulation environments, Python, PyTorch, JAX, technical leadership
Preferred skills
Agentic systems, trajectory-based data generation, on-device ML, post-training (SFT, DPO, RLHF)
Technologies
Python, PyTorch, JAX
Responsibilities
Designing and building evaluation infrastructure for agents and foundation models; Developing LLM judges and reward models calibrated against human feedback; Building and integrating simulation environments for agent evaluation; Developing prompt and context optimization pipelines; Setting technical direction for the evaluation system
Seniority
Senior, hands-on IC
