CareerPlan

Senior Applied AI Engineer (GenAI & LLM Evaluation)

Full-time2026-11-16

Core

Build and improve AI-powered data products by developing scalable data pipelines, GenAI evaluation frameworks, and deploying production-ready AI solutions.

Role type

Senior Applied AI Engineer (GenAI & LLM Evaluation)

Builds

Scalable data pipelines, GenAI evaluation frameworks, production-ready AI solutions

Domain

Generative AI, Large Language Models (LLMs), Data Engineering

Deliverable

production ML models

Required skills

Python, SQL, Generative AI, LLM evaluation (golden datasets, benchmarking, LLM-as-a-Judge), data pipeline design, API integration, cloud-based AI services

Preferred skills

Consulting or customer-facing experience

Technologies

Python, SQL, Cloud-based AI services

Responsibilities

Build and maintain scalable data pipelines and workflows; Develop evaluation frameworks for GenAI and LLM applications; Create and maintain golden datasets for model testing; Evaluate and benchmark LLM performance; Build ML-assisted tools to improve delivery and automation; Deploy production-ready AI solutions

Seniority

Senior, hands-on IC