CareerPlan

Principal Software Engineer - AI Systems Observability

United States, Multiple Locations, Multiple LocationsFull-time2026-10-08 → 2026-11-09

Core

Design and implement observability solutions for AI agent workflows across Kubernetes and Linux environments, ensuring safe, evaluable, and reliable system operations.

Role type

Principal Software Engineer (AI Systems Observability)

Builds

Production observability tools, AI agent systems, and distributed-systems capabilities

Domain

Cloud Infrastructure, AI Systems, Observability

Deliverable

production ML models

Required skills

Kubernetes, Linux, eBPF, C, C++, Go, Python, Rust, distributed systems, incident response, system design, mentorship

Preferred skills

cross-product feature development, open-source contribution, technical architecture adoption

Technologies

Kubernetes, Linux, eBPF, C, C++, Go, Python, Rust

Responsibilities

Partner with stakeholders to define requirements for agentic observability scenarios; lead design and development of observability products; mentor engineers on code quality and best practices; collect and interpret systems signals using eBPF; participate in on-call monitoring and incident response; drive project and release plans across teams.

Seniority

Principal, hands-on IC with strategy & mentorship