CareerPlan

Senior Machine Learning Engineer - Applied Scientist

United States, Washington, RedmondFull-time2026-10-19 → 2026-11-10

Core

Lead applied science strategy for AI-powered product areas, defining success metrics and operationalizing LLM evaluation frameworks across the product lifecycle.

Role type

Senior IC applied scientist (LLM evaluation & strategy)

Builds

AI systems with strong attention to reliability, scalability, latency, observability, and MLOps best practices

Domain

Artificial Intelligence / Large Language Models / Product Strategy

Deliverable

production ML models

Required skills

LLM evaluation, prompt engineering, RAG, agentic systems, multimodal AI, offline experimentation, MLOps, hypothesis testing, metric definition, technical leadership

Preferred skills

None stated

Technologies

LLMs, RAG, agents, multimodal systems

Responsibilities

Lead applied science strategy for AI-powered product areas; Design and operationalize LLM evaluation frameworks; Partner with engineering and PM leadership to align science priorities; Mentor scientists and engineers; Drive fast iteration cycles by forming hypotheses and interpreting results

Seniority

Senior, hands-on IC