Machine Learning Engineer, Evaluation and Quality, Creativity Apps
Core
Define evaluation strategy and metrics for ML models and AI features in creativity apps, building datasets and infrastructure to ensure quality from development to shipping.
Role type
Senior IC machine learning engineer (evaluation and quality)
Builds
Evaluation datasets, evaluation infrastructure, and quality metrics for AI features
Domain
Generative AI, Creativity Apps
Deliverable
production ML models
Required skills
ML model evaluation, LLM evaluation, agentic workflows, data curation, dataset quality, evaluation infrastructure design, evaluation metrics design, quality reporting, Python, Swift
Preferred skills
Image/video quality evaluation, color science, iOS/macOS familiarity, creative application experience
Technologies
Python, Swift, LLMs, agentic workflows
Responsibilities
Define evaluation strategy and metrics for ML models and AI features; Curate and create evaluation datasets; Design and maintain evaluation infrastructure at scale; Apply ML and agentic workflows to automated evaluation; Drive end-to-end quality from model checkpoints to shipping features; Report quality results to technical and non-technical audiences
Seniority
Senior, hands-on IC