Tech Lead Manager, AI Evaluations
Core
Lead a team to build the evaluation strategy and platform ensuring reliable, high-quality AI experiences for Glean's Work AI ecosystem.
Role type
Senior IC Tech Lead Manager (AI Evaluations)
Builds
Scalable evaluation infrastructure, trusted quality signals, and continuous self-improvement loops for LLMs, assistants, and agents.
Domain
Enterprise AI / Generative AI / Evaluation Systems
Deliverable
production ML models
Required skills
AI evaluation strategy, LLM/GenAI product evaluation, team leadership, Python, distributed systems, data modeling, CI/CD integration, statistical analysis, rubric design, agent evaluation, red teaming
Preferred skills
Agent evaluation (tool calling, trajectories), safety testing, public benchmark knowledge
Technologies
Python, Kubernetes, Cloud Infrastructure, Data Stores, Observability
Responsibilities
Own the AI evaluation engineering roadmap; build scalable evaluation infrastructure; create and maintain representative evaluation sets; define balanced quality measurement systems; integrate evaluation into development and operations; build and lead a high-performing team.
Seniority
Senior, hands-on IC with management responsibilities
