CareerPlanSign in

Machine Learning Engineer, Core Experimentation

Seattle💼 Full-time🗓 2026-09-24 → 2026-09-25

Core

Lead technical direction for ML-powered experimentation and insights capabilities, building production systems that learn from product data to generate evidence-backed insights and support high-stakes product decisions.

Role type

Senior IC machine learning engineer (experimentation platform)

Builds

Generative Insights and Predictive Experimentation platform, cross-experiment learning systems, predictive models, simulation workflows, and durable product/API/agent workflows.

Domain

AI/ML, Experimentation, Causal Inference, LLMs, Statistical Methods

Deliverable

production ML models | product features

Required skills

ML lifecycle ownership, LLM and retrieval systems, causal ML or experiment analysis, simulation-based evaluation, Python software engineering, statistical reasoning, data pipeline design, technical leadership

Preferred skills

Ambiguous 0-to-1 product experience, hands-on ML deployment and monitoring, translating partner questions into roadmaps, building for internal power users

Technologies

Python, LLM systems, retrieval systems, simulation workflows

Responsibilities

Set and execute technical roadmap for Generative Insights and Predictive Experimentation; Build cross-experiment learning systems to retrieve and synthesize historical experiments; Develop predictive models and simulation workflows to estimate impact and uncertainty; Create high-quality datasets and feature/retrieval pipelines with strong lineage and privacy controls; Establish rigorous evaluation through offline benchmarks, backtests, and drift monitoring; Turn models into durable product, API, and agent workflows; Partner with data science and product teams on experiment design and causal inference; Provide technical leadership across engineering, product, data science, and research partners.

Seniority

Senior, hands-on IC with technical leadership

Sourced via ashby · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.