CareerPlanSign in

Senior Machine Learning Platform Engineer

USA🌐 Remote💼 Full-time🗓 2026-09-17 → 2026-09-25

Core

Design and maintain highly available, low-latency ML inference infrastructure for predictive models and LLMs, build and optimize streaming pipelines for fresh feature data, and improve distributed training infrastructure.

Role type

Senior IC machine learning platform engineer

Builds

Production ML inference systems, streaming feature pipelines, and distributed training infrastructure

Domain

Machine Learning Infrastructure / Distributed Systems

Deliverable

infrastructure

Required skills

distributed systems design, low-latency system optimization, streaming pipeline development, distributed training optimization, observability tooling, technical leadership, code review, design review

Preferred skills

feature store implementation, model serving framework expertise, training orchestration, generative AI workflow integration

Technologies

streaming pipelines, online serving systems, distributed training frameworks, feature stores, model serving frameworks, training orchestration tools

Responsibilities

Design and maintain highly available, low-latency ML inference infrastructure; Build and optimize streaming pipelines for feature data; Improve distributed training infrastructure; Develop observability tooling for data quality and model performance; Mentor junior engineers and raise engineering standards

Seniority

Senior, hands-on IC with technical leadership

Sourced via codingjobboard · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.