Senior Staff Machine Learning Engineer, Data & Eval
Core
Define evaluation strategy and build data flywheels for GenAI systems powering customer support agents and tools.
Role type
Senior Staff Machine Learning Engineer (Evaluation & Data)
Builds
Evaluation frameworks, data pipelines, and quality systems for GenAI/LLM applications.
Domain
Travel marketplace, Generative AI, Customer Support
Deliverable
production ML models
Required skills
Evaluation methodology, GenAI system orchestration, data pipeline engineering, ML lifecycle management
Preferred skills
Customer support ML workflows, evaluation platforms at scale, agile applied AI practice
Technologies
LLMs, RAG, automated testing frameworks, dataset versioning tools
Responsibilities
Define evaluation strategy and success metrics for GenAI systems; Build and scale evaluation frameworks with bias/drift controls; Design the data flywheel for feedback and continuous improvement; Lead cross-functional quality initiatives; Develop and productionize pipelines for dataset creation and model monitoring; Drive technical decisions and architecture for evaluation infrastructure
Seniority
Senior Staff, hands-on IC with strategic leadership