Senior AI Product Engineer, Backend
Core
Building scalable distributed backend services and APIs for an AI observability platform that monitors, troubleshoots, and optimizes AI/LLM systems.
Role type
Senior IC backend engineer (distributed systems & AI infrastructure)
Builds
Highly available analytics systems, APIs for ML/LLM workflows, and core platform services for enterprise AI teams
Domain
AI/LLM observability, distributed systems, high-performance backend infrastructure
Deliverable
production ML models | product features | infrastructure
Required skills
Go, Python, TypeScript/Node, Java, distributed systems design, high-performance backend development, cloud platforms (AWS/GCP/Azure), container orchestration (Kubernetes)
Preferred skills
Kafka/stream processing, OLAP systems, Prometheus, dimensionality reduction algorithms, LLM product development
Technologies
Go, Python, TypeScript, Java, Kubernetes, AWS, GCP, Azure, Kafka, Prometheus, OLAP databases
Responsibilities
Write maintainable, scalable backend code in Go/Python/TypeScript/Java; Build high-volume analytics systems; Design and build APIs for ML/LLM workflows; Prototype and optimize scalable backend services; Extend open source OLAP databases and message queue frameworks; Develop collection tools for monitoring ML/LLM pipelines; Research and implement visualization and dimensionality reduction algorithms; Collaborate with product and customer engineering teams; Contribute to in-house AI Agents
Seniority
Senior, hands-on IC
