Staff AI Product Analyst
Core
Define AI-native product analytics, design evaluation frameworks for agentic AI workflows, and establish data governance standards to ensure trust and quality in AI-driven business outcomes.
Role type
Staff AI Product Analyst (Senior IC)
Builds
Agentic product analytics capability, evaluation frameworks, and trusted data ecosystems for AI agents.
Domain
Home services industry + AI/LLM systems
Deliverable
production ML models
Required skills
Product analytics, data science, technical product management, Python, ML frameworks, data visualization, data governance, AI evaluation framework design, causal inference, systems thinking
Preferred skills
Agentic analytics workflows, orchestration frameworks, multi-agent systems, structured experimentation, ambiguity navigation
Technologies
Python, ML frameworks, data visualization platforms, RAG, APIs
Responsibilities
Define north-star and guardrail metrics for flagship AI journeys; design formal evaluation sets, golden datasets, and regression checks for agent outputs; map agent interactions with data layers and APIs; monitor live usage of Agentic AI workflows and manage improvement backlogs; create internal playbooks for agent usage and uncertainty communication; partner with business leaders to translate AI capabilities into measurable outcomes.
Seniority
Staff, broad influence across function
