Senior AI Product Engineer, Backend
Core
Building highly scalable distributed services and analytics systems for an ML observability platform, including APIs for ML/LLM workflows and real-time evaluation infrastructure.
Role type
Senior IC backend engineer (distributed systems & ML infrastructure)
Builds
Scalable backend services, high-volume analytics systems, and APIs for ML/LLM workflows
Domain
Cloud infrastructure, distributed systems, Machine Learning observability
Deliverable
production ML models
Required skills
Go, Python, TypeScript/Node, Java, high-performance backend systems, cloud platforms (AWS/GCP/Azure), container orchestration (Kubernetes), OLAP databases, distributed message queues
Preferred skills
Distributed stream processing, system observability tooling, Machine Learning/Data Science, Large Language Models (LLMs), AI product development
Technologies
Go, Python, TypeScript, Java, AWS, GCP, Azure, Kubernetes, Kafka, Prometheus
Responsibilities
Write maintainable, scalable backend code; build high-volume analytics systems; design and build APIs for ML/LLM workflows; prototype and optimize backend services; extend open source OLAP databases and message queue frameworks; develop collection tools for ML/LLM pipeline monitoring; research and implement visualization/dimensionality reduction algorithms; collaborate with product and customer engineering teams; contribute to in-house AI Agents
Seniority
Senior, hands-on IC