Senior Applied AI Engineer (GenAI & LLM Evaluation)
Core
Build and improve AI-powered data products by developing scalable data pipelines, GenAI evaluation frameworks, and deploying production-ready AI solutions.
Role type
Senior Applied AI Engineer (GenAI & LLM Evaluation)
Builds
Scalable data pipelines, GenAI evaluation frameworks, production-ready AI solutions
Domain
Generative AI, Large Language Models (LLMs), Data Engineering
Deliverable
production ML models
Required skills
Python, SQL, Generative AI, LLM evaluation (golden datasets, benchmarking, LLM-as-a-Judge), data pipeline design, API integration, cloud-based AI services
Preferred skills
Consulting or customer-facing experience
Technologies
Python, SQL, Cloud-based AI services
Responsibilities
Build and maintain scalable data pipelines and workflows; Develop evaluation frameworks for GenAI and LLM applications; Create and maintain golden datasets for model testing; Evaluate and benchmark LLM performance; Build ML-assisted tools to improve delivery and automation; Deploy production-ready AI solutions
Seniority
Senior, hands-on IC