CareerPlan

Founding Data Scientist

San FranciscoFull-time2026-11-02 → 2026-11-11

Core

Define metrics, design experiments, and analyze data to measure the impact of AI agents and product features on real-world client outcomes.

Role type

Founding Data Scientist (Product Analytics & ML Evaluation)

Builds

Dashboards, self-serve tools, and analytical frameworks for product and ML teams.

Domain

AI Infrastructure / Enterprise Automation / Generative AI

Deliverable

dashboards & analysis

Required skills

Experimental design, A/B testing, statistics, causal inference, SQL, Python, product metrics definition, root-cause analysis, statistical modeling

Preferred skills

LLMs, AI agents, generative AI, probabilistic ML, unstructured data analysis, enterprise/B2B products, modern analytics infrastructure

Technologies

SQL, Python, experimentation platforms, data warehouses, business intelligence tools

Responsibilities

Define and track product, feature, and agent-level metrics; Design, run, and interpret A/B tests for model changes and agent behavior; Measure agent performance impact on client outcomes; Connect offline model evaluations with production performance; Conduct deep analyses across conversations and workflows; Investigate anomalies and perform root-cause analyses; Build statistical models and analytical frameworks; Partner with Engineering to improve instrumentation and data quality; Build dashboards and self-serve tools.

Seniority

Senior, hands-on IC with founder mindset