Senior Data Scientist
Core
Develop metrics for copilot usage and quality, drive instrumentation and measurement approaches, and enable A/B experimentation for new features.
Role type
Senior Data Scientist (Product Analytics & Experimentation)
Builds
Product features and analytics dashboards for copilot usage evaluation
Domain
AI / Large Language Models (LLMs) / Product Analytics
Deliverable
production ML models
Required skills
A/B testing design and execution, metrics creation, trend analysis, Python, R, C#, prompt engineering, LLM usage, data pipeline building, statistical techniques, telemetry analysis
Preferred skills
Experience with complex data management, sophisticated algorithm development, product knowledge, clean code practices
Technologies
Python, R, C#, LLMs
Responsibilities
Develop metrics for copilot usage and quality, enable A/B experimentation for new features, analyze large volumes of telemetry data, articulate insights and communicate to leadership, build data pipelines for analytics and experiments
Seniority
Senior, hands-on IC
