Senior Software Engineer, Agent Oversight
Core
Build platform infrastructure for observing, evaluating, and improving production agentic AI applications at scale.
Role type
Senior Software Engineer (Platform/Infrastructure)
Builds
Observability tooling, evaluation harnesses, data pipelines, and APIs for agent telemetry and performance metrics.
Domain
Generative AI / Agentic AI / Enterprise AI Platforms
Deliverable
production ML models | infrastructure
Required skills
backend/distributed systems, API design, data pipeline design, production software for ML/LLM products, observability/monitoring, system reliability, end-to-end ownership
Preferred skills
agent architectures (tool use, planning, multi-agent orchestration), MLOps, feature stores, model serving, regulated/enterprise context experience, mentoring
Technologies
None explicitly listed
Responsibilities
Design and build core platform capabilities for deploying, monitoring, and evaluating agentic applications; Build reliable APIs and data pipelines capturing agent telemetry and evaluation signals; Partner with ML engineers to integrate evaluation loops into platform workflows; Own reliability, scalability, and observability of platform components; Translate customer deployment requirements into platform features; Build features end-to-end from design through production; Participate in high-velocity experimentation to validate platform capabilities.
Seniority
Senior, hands-on IC
