Senior Data Scientist, Experimentation & AI Measurement
Core
Design, build, and validate statistically rigorous methods for online experimentation and AI measurement to ensure trustworthy decision-making and quantify the value of AI-assisted engineering tools.
Role type
Senior individual-contributor data scientist (experimentation & causal inference)
Builds
Self-service experimentation platform capabilities, automated guardrails, and measurement frameworks for AI impact
Domain
Real Estate / Online Experimentation / Causal Inference / AI Measurement
Deliverable
production ML models
Required skills
Causal inference, experimental design (frequentist/Bayesian), statistical rigor, Python, SQL, telemetry analysis, metric definition, technical storytelling
Preferred skills
AI/ML measurement (LLMs, agentic tools), variance-reduction techniques, sequential testing
Responsibilities
Design and validate experiment design methods; build automated guardrails for experiment monitoring; lead experiment design reviews for high-visibility launches; define and scale measurement frameworks for AI impact; pair velocity signals with quality measures; mentor junior scientists and analysts (via careerplan.io/jobs/P751328-1-senior-data-scientist-experimentation-ai-measurement-at-zillow)
Seniority
Senior, hands-on IC with mentorship
