Principal Software Engineer - AI Systems Observability
Core
Design and implement observability solutions for AI agent workflows across Kubernetes and Linux environments, ensuring safe, evaluable, and reliable system operations.
Role type
Principal Software Engineer (AI Systems Observability)
Builds
Production observability tools, AI agent systems, and distributed-systems capabilities
Domain
Cloud Infrastructure, AI Systems, Observability
Deliverable
production ML models
Required skills
Kubernetes, Linux, eBPF, C, C++, Go, Python, Rust, distributed systems, incident response, system design, mentorship
Preferred skills
cross-product feature development, open-source contribution, technical architecture adoption
Technologies
Kubernetes, Linux, eBPF, C, C++, Go, Python, Rust
Responsibilities
Partner with stakeholders to define requirements for agentic observability scenarios; lead design and development of observability products; mentor engineers on code quality and best practices; collect and interpret systems signals using eBPF; participate in on-call monitoring and incident response; drive project and release plans across teams.
Seniority
Principal, hands-on IC with strategy & mentorship