CareerPlan

Senior AI Product Engineer, Backend

RemoteFull-time$125k2026-09-28 → 2026-11-15
Hybrid · United States

Core

Building highly scalable distributed services and analytics systems for an ML observability platform, including APIs for ML/LLM workflows and real-time evaluation infrastructure.

Role type

Senior IC backend engineer (distributed systems & ML infrastructure)

Builds

Scalable backend services, high-volume analytics systems, and APIs for ML/LLM workflows

Domain

Cloud infrastructure, distributed systems, Machine Learning observability

Deliverable

production ML models

Required skills

Go, Python, TypeScript/Node, Java, high-performance backend systems, cloud platforms (AWS/GCP/Azure), container orchestration (Kubernetes), OLAP databases, distributed message queues

Preferred skills

Distributed stream processing, system observability tooling, Machine Learning/Data Science, Large Language Models (LLMs), AI product development

Technologies

Go, Python, TypeScript, Java, AWS, GCP, Azure, Kubernetes, Kafka, Prometheus

Responsibilities

Write maintainable, scalable backend code; build high-volume analytics systems; design and build APIs for ML/LLM workflows; prototype and optimize backend services; extend open source OLAP databases and message queue frameworks; develop collection tools for ML/LLM pipeline monitoring; research and implement visualization/dimensionality reduction algorithms; collaborate with product and customer engineering teams; contribute to in-house AI Agents

Seniority

Senior, hands-on IC