Data Scientist, Codex
Core
Measure and accelerate product-market fit for AI developer tools by defining developer productivity, running experiments on coding models, and analyzing impact across languages and tasks.
Role type
Product Data Scientist (AI Developer Tools)
Builds
AI coding models and developer productivity tools
Domain
Artificial Intelligence / Software Engineering / Developer Productivity
Deliverable
dashboards & analysis
Required skills
SQL, Python, experiment design, causal inference, product metrics definition
Preferred skills
programming background, IDE/extension telemetry analytics, NLP/LLMs, code model evaluations
Technologies
SQL, Python
Responsibilities
Design and interpret A/B tests and staged rollouts of new coding models; Define and operationalize metrics such as suggestion acceptance, edit distance, and task completion; Build dashboards and analyses for product questions; Diagnose failure modes and partner with Research on model improvements
Seniority
Mid-Senior, hands-on IC