CareerPlanSign in

Data Scientist

San Francisco💼 Full-time🗓 2025-08-30 → 2026-09-25

Core

Define metrics, run experiments, and build dashboards to optimize product performance, matching quality, and revenue for an AI data platform.

Role type

Junior data scientist (product analytics & experimentation)

Builds

Production dashboards, lightweight data models, and evaluation frameworks for ranking and LLM agents

Domain

AI data infrastructure, marketplace analytics, and LLM evaluation

Deliverable

dashboards & analysis

Required skills

SQL, Python, experiment design, causal thinking, statistics

Preferred skills

dbt, LLM/agent evaluation, retrieval and ranking metrics

Technologies

SQL, Python, dbt, Hex, Mode, Looker

Responsibilities

Define north-star and feature-level metrics for ranking and interview systems; Design and run A/B tests and quasi-experiments; Build source-of-truth dashboards and lightweight data models; Instrument events and improve data quality; Prototype models to improve matching and scoring; Evaluate LLM-powered agents using rubrics and human-in-the-loop studies

Seniority

Junior, 0–2 years experience

Sourced via ashby · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.