CareerPlan

Software Engineer, Insights

San Francisco, CAFull-time2026-10-22 → 2026-11-10
On-site

Core

Build systems for analyzing, visualizing, and monitoring AI agent performance data to enable data-driven decisions and defect detection.

Role type

Senior full-stack software engineer (AI observability & experimentation)

Builds

Reporting & experimentation systems, data exploration tools (Explorer), and proactive monitoring systems for AI agents

Domain

Artificial Intelligence / Customer-facing AI agents

Deliverable

production ML models

Required skills

Full-stack development, Data analysis & visualization, A/B testing infrastructure, System monitoring, Go, TypeScript

Preferred skills

AI-powered product building, Design sensibility, Developer tooling, Programming languages, Databases, Technical leadership

Technologies

Go, TypeScript

Responsibilities

Build systems for analyzing and visualizing millions of data points about agent performance; Enable agent developers to run A/B tests; Build systems for proactively monitoring agents for defects or new patterns

Seniority

Senior, hands-on IC