Lead Product Data Scientist, Agents
Core
Lead the measurement and data science strategy for Klaviyo's AI marketing and customer engagement agents (Composer and Customer Agent), defining frameworks to evaluate agent performance, causal impact, and business value.
Role type
Senior IC product data scientist (AI agents)
Builds
Scalable agent evaluation frameworks, trusted metrics, and self-service analytics capabilities for AI products.
Domain
AI/LLM product development, marketing automation, customer engagement
Deliverable
production ML models
Required skills
Causal inference, experimentation design, SQL, Python, LLM evaluation, statistical modeling, product strategy
Preferred skills
AI-first analytics, mentoring, technical leadership
Technologies
SQL, Python, dbt, LLMs, coding agents
Responsibilities
Define measurement frameworks for AI agent adoption, engagement, and business impact; measure causal impact via quasi-experimental methods; build scalable evaluation frameworks using conversation data and LLM-based classification; partner with Product/Finance to evaluate pricing and monetization; establish analytical standards and mentor data scientists; leverage coding agents and LLMs to accelerate analytical workflows.
Seniority
Senior, hands-on IC
