CareerPlanSign in

Senior ML Ops Engineer

NYC Office💼 Full-time🗓 2026-07-06 → 2026-09-25

Core

Own the end-to-end ML platform infrastructure, pipelines, and cloud foundation to serve document-understanding, forecasting, and agentic systems at scale.

Role type

Senior ML Ops Engineer (Platform Owner)

Builds

Production ML pipelines, serving infrastructure, and cloud foundation for hundreds of thousands of documents and heavy LLM/VLM workloads.

Domain

AI Infrastructure / Cloud Engineering / CPG

Deliverable

production ML models

Required skills

End-to-end ML pipeline ownership, Cloud infrastructure design, Infrastructure as Code, CI/CD for ML, Inference optimization, Data interface management, Observability and security for ML

Preferred skills

LLMOps tooling, Inference optimization (vLLM, ONNX, TensorRT), ML orchestration (MLflow, Ray, Airflow), Large-scale data systems (Snowflake, Kafka), Managed ML services

Technologies

Python, Ruby, AWS, Terraform, Kubernetes, GitHub Actions, Snowflake, Aurora, Redis, Kafka

Responsibilities

Own ML pipelines from experimentation to production; Provide reproducible environments and fast paths from prototype to production; Stand up cloud foundation as IaC and CI/CD; Serve and optimize inference and forecasting workloads; Own data interface with data engineering; Ensure reliability, observability, security, and privacy with online evals

Seniority

Senior, hands-on IC

Sourced via ashby · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.