Sr. Staff Machine Learning Systems Engineer
Core
Designing and scaling evaluation infrastructure, data pipelines, and statistical testing frameworks to ensure AI/ML models are safe and effective for patient care.
Role type
Senior Staff Machine Learning Systems Engineer (Evaluation & Infrastructure)
Builds
Evaluation systems, data pipelines, statistical testing frameworks, and reporting surfaces for AI safety.
Domain
Healthcare + Machine Learning Systems
Deliverable
production ML models
Required skills
ML infrastructure design, data pipeline engineering, statistical testing methodology, LLM judge/scorer design, adversarial/red-team evaluation, cross-team leadership, Python, mentoring
Preferred skills
Databricks, MLflow, Unity Catalog, regulated industry experience (healthcare/fintech), non-technical reporting tools
Technologies
Python, Databricks, MLflow, Unity Catalog
Responsibilities
Set technical direction for evaluation systems and statistical methodology; design and scale data ingestion and transformation pipelines; lead multi-team initiatives to automate evaluation gates; architect adversarial and red-team testing suites; mentor senior engineers and raise technical standards.
Seniority
Senior Staff, hands-on IC with strategic scope