CareerPlan

Sr. Staff Machine Learning Systems Engineer

US - RemoteRemoteFull-time2026-08-18 → 2026-11-20

Core

Designing and scaling evaluation infrastructure, data pipelines, and statistical testing frameworks to ensure AI/ML models are safe and effective for patient care.

Role type

Senior Staff Machine Learning Systems Engineer (Evaluation & Infrastructure)

Builds

Evaluation systems, data pipelines, statistical testing frameworks, and reporting surfaces for AI safety.

Domain

Healthcare + Machine Learning Systems

Deliverable

production ML models

Required skills

ML infrastructure design, data pipeline engineering, statistical testing methodology, LLM judge/scorer design, adversarial/red-team evaluation, cross-team leadership, Python, mentoring

Preferred skills

Databricks, MLflow, Unity Catalog, regulated industry experience (healthcare/fintech), non-technical reporting tools

Technologies

Python, Databricks, MLflow, Unity Catalog

Responsibilities

Set technical direction for evaluation systems and statistical methodology; design and scale data ingestion and transformation pipelines; lead multi-team initiatives to automate evaluation gates; architect adversarial and red-team testing suites; mentor senior engineers and raise technical standards.

Seniority

Senior Staff, hands-on IC with strategic scope