CareerPlanSign in

Senior Backend Engineer: Machine Learning Infrastructure

🌐 Remote💼 Full-time💰 $80,000–$80,000🗓 2026-09-24 → 2026-10-01

Core

Build and operate shared backend services and platform capabilities for ML and product teams to develop, deploy, and run machine learning at scale, including model serving (LLMs) and data pipelines.

Role type

Senior Backend Engineer (ML Infrastructure)

Builds

High-load distributed backend services, self-service infrastructure components, and core ML services/pipelines for ML and product teams.

Domain

E-commerce, Machine Learning Infrastructure, Cloud Platforms

Deliverable

infrastructure

Required skills

Python, distributed systems design, high-load API development, cloud platforms (AWS/GCP/Azure), Kubernetes, system design, data structures and algorithms

Preferred skills

Rust/C/C++/Go, ML platform development, vector databases (Qdrant/Milvus/Weaviate/OpenSearch/pgvector), model serving/inference infrastructure, Infrastructure as Code (Terraform)

Responsibilities

Design and operate high-load distributed backend services; take end-to-end ownership of core ML services and data pipelines; partner with ML and product teams to build reusable platform capabilities; make and defend technical decisions regarding system design and trade-offs.

Seniority

Senior, hands-on IC

Sourced via ashby · Listed on CareerPlan, which tracks 902,000+ jobs from 20+ sources.