Senior Software Engineer II, Observability
Core
Design, build, and own core observability infrastructure including highly scalable logging, metrics, and tracing platforms for AI clusters.
Role type
Senior Software Engineer II, Observability
Builds
Scalable observability platforms (logging, metrics, tracing) and telemetry pipelines for AI infrastructure
Domain
Cloud Infrastructure / AI Systems / Observability
Deliverable
production ML models
Required skills
Go, Python, Kubernetes, Distributed Systems, Telemetry Pipelines, Infrastructure as Code (Helm, YAML), On-call Support
Preferred skills
Loki, ClickHouse, Elasticsearch, Prometheus, VictoriaMetrics, Grafana, Thanos, Kafka, OpenTelemetry, Terraform, MLOps
Technologies
Go, Python, Kubernetes, Helm, YAML, Kafka, OpenTelemetry, Terraform, Loki, ClickHouse, Elasticsearch, Prometheus, VictoriaMetrics, Grafana, Thanos
Responsibilities
Design and build scalable logging, metrics, and tracing platforms; Develop and operate high-throughput telemetry pipelines; Support clusters of thousands of GPUs and petabyte-scale telemetry; Participate in on-call rotation for root cause analysis; Collaborate with internal teams to embed observability best practices; Contribute to observability strategy
Seniority
Senior, hands-on IC