Applied Scientist
Core
Develop metrics and evaluation methodologies to measure AI system quality, accuracy, and usability; design experiments to quantify product improvements; build scalable data pipelines and analytical tools for continuous quality monitoring.
Role type
Senior Applied Scientist (AI Evaluation & Experimentation)
Builds
Scalable data pipelines, dashboards, and analytical tools for AI quality monitoring
Domain
Artificial Intelligence, Statistics, Data Science
Deliverable
production ML models | dashboards & analysis
Required skills
Statistical analysis, machine learning, data mining, experiment design, root cause analysis, data-driven prioritization, technical communication
Preferred skills
Publication creation (patents, peer-reviewed papers), conference speaking, research program leadership, live production system deployment, full product cycle development
Technologies
N/A
Responsibilities
Design and analyze online/offline experiments to quantify product improvements; Build scalable data pipelines and dashboards for continuous quality monitoring; Investigate quality regressions and propose measurable improvements; Shape best practices for AI evaluation and responsible AI measurement; Partner with engineering and product teams on data-driven investment prioritization
Seniority
Senior, hands-on IC with research leadership
