Senior Data Scientist - Outlook Science Team
Core
Lead analytical frameworks and evaluation for Outlook Mail, Calendar, Search, and Copilot experiences, focusing on generative AI quality, product health, and causal impact.
Role type
Senior IC data scientist (product analytics & AI evaluation)
Builds
Trusted dashboards, semantic models, reporting pipelines, and evaluation frameworks for AI-powered product experiences.
Domain
Enterprise productivity software (Outlook) + Generative AI
Deliverable
production ML models | dashboards & analysis | product features
Required skills
causal inference, A/B testing, prompt engineering, LLM evaluation, statistical modeling, telemetry analysis, metrics definition, experimental design, data storytelling, privacy-conscious analytics
Preferred skills
Generative AI technologies (LLMs, RAG, agentic systems), Azure Data Explorer/Kusto, Databricks, Synapse, Power BI, product analytics for communication/collaboration tools
Technologies
Azure Data Explorer, Kusto, Azure Data Lake, Synapse, Databricks, Data Factory, Power BI, SQL, Python, R
Responsibilities
Design and execute analytical frameworks to evaluate product investments; define metrics and success criteria for AI features; analyze online/offline experiments to estimate causal impact; develop dashboards and semantic models for product health monitoring; evaluate generative AI experiences using benchmark datasets and human judgment; partner with engineers on model selection and measurement strategies; influence product strategy with actionable insights to senior leaders; provide technical mentorship on statistical rigor and reproducibility.
Seniority
Senior, hands-on IC