Principal Data Scientist, Core Shopping Data Science
Core
Define, validate, and enforce store quality metrics (relevance, duplication, staleness) using LLMs to improve the Amazon shopping experience for customers and advertisers.
Role type
Principal Data Scientist (Strategy & Technical Leadership)
Builds
Tooling for metric validation (walk-the-store bots, automated experiment inspection, VoC feedback loops) and evidence-based alignment frameworks.
Domain
E-commerce, Retail, Large Language Models (LLMs), Measurement Science
Deliverable
production ML models | dashboards & analysis
Required skills
Statistical inference, experimental design, sampling methodology, Python, SQL, LLM evaluation as judges/annotators, cross-organizational alignment
Preferred skills
E-commerce search/recommendations/advertising quality, communicating quantitative findings to senior executives, building reproducible analysis tooling
Technologies
Python, SQL, LLMs, Gecko (experiment inspection tool)
Responsibilities
Validate store quality metrics end-to-end (definitions, LLM implementation, accuracy); Identify gaps between Organic and Ads treatments; Drive alignment through deep-dive evidence presentations; Build tooling for repeatable metric validation; Own analytical rigor for subjective metrics
Seniority
Principal, strategy & mentorship