Lead Forward Deployed Engineer, AI Evaluation Platform
Core
Lead the adoption strategy and solutions for Apple's AI evaluation platform, acting as a bridge between research science and engineering teams to operationalize measurement techniques for LLMs and agentic systems.
Role type
Lead Forward Deployed Engineer (Strategic IC)
Builds
Self-service AI evaluation tools, SDKs, and production-grade services for internal ML practitioners
Domain
Artificial Intelligence / Machine Learning Evaluation
Deliverable
production ML models
Required skills
Solutions Architecture, Developer Advocacy, Technical Program Management, AI/ML lifecycle literacy, stakeholder management, roadmap definition, cross-functional collaboration
Preferred skills
AI Evaluation Frameworks (DeepEval, Ragas, TruLens, LangSmith), self-service adoption design, Chief of Staff experience, bridging research and production environments
Technologies
DeepEval, Ragas, TruLens, LangSmith
Responsibilities
Partner with Science, Platform Engineering, and Product Management to align strategy with execution; Integrate evaluation primitives and SDKs into feature team workflows; Gather developer feedback on API quality and experience to inform roadmap; Build demos, tutorials, and reference implementations for community building; Translate novel metrics and algorithms into scalable production services
Seniority
Senior, hands-on IC with strategic influence