Software Engineer, Backend
Core
Build the infrastructure and data platform for an agent observability tool that traces LLM usage and performance for teams at major tech companies.
Role type
Senior backend engineer (high-availability data platform)
Builds
Real-time ingestion pipelines, open source libraries for tracing/evaluating LLM calls, and SDKs for customer applications.
Domain
AI/LLM observability and high-scale data infrastructure
Deliverable
production ML models | infrastructure
Required skills
Backend engineering, systems thinking, scaling infrastructure, data integrity design, observability tooling, cloud infrastructure (AWS), containerization (Docker), infrastructure as code (Terraform)
Preferred skills
Experience with Node.js, Go, Python, Rust, Postgres, Redis, Grafana, Prometheus, Datadog
Technologies
Node.js, Go, Python, Rust, Postgres, Redis, Terraform, Docker, AWS, Grafana, Prometheus, Datadog
Responsibilities
Design and ship features for deep insight into LLM usage and performance; integrate, proxy, cache, and collect data from major model providers; develop robust open source libraries for tracing and evaluating LLM calls; build highly available real-time data pipelines to ingest, store, and query AI usage data; collaborate with product engineers to ship end-to-end features like code snippet bundling and attachment storage.
Seniority
Senior, hands-on IC
