Agent Data Scientist
Core
Define, operationalize, and improve metrics for AI agent deployments to demonstrate value to enterprise customers.
Role type
Senior individual contributor data scientist (metrics & product strategy)
Builds
Product features, tools, and frameworks for measuring AI agent performance
Domain
Conversational AI / Customer Experience / Enterprise SaaS
Deliverable
production ML models | product features | dashboards & analysis
Required skills
End-to-end data analysis, metric definition, experimental design, stakeholder alignment, SQL, Python, unstructured data handling
Preferred skills
Building internal tooling, evaluating LLM/agent behavior in production
Technologies
SQL, Python
Responsibilities
Work with customers to define and operationalize performance metrics; Own delivery and improvement of key metrics; Scope and build product features/tools for measurement; Define success criteria for new initiatives; Provide feedback to Product, Engineering, and Research
Seniority
Senior, hands-on IC