Principal Product Manager - AI Observability (Chronosphere)
Core
Lead the development of AI Observability and Evaluation features for developers to measure the accuracy, relevance, performance, and safety of AI models, agents, and RAG applications.
Role type
Principal Product Manager (AI Observability)
Builds
AI Observability and Evaluation features integrated into the Chronosphere platform
Domain
Cybersecurity, Cloud Native Monitoring, Artificial Intelligence (LLMs, Agentic AI)
Deliverable
production ML models | product features
Required skills
Enterprise software product management, Machine Learning and Foundational Model product experience, Large Language Model quality metrics (entropy, cross entropy, perplexity), AI Observability and Evaluation methodologies, Cloud native monitoring, SaaS operations, Agile processes
Preferred skills
Experience with major models and agent platforms, Deep understanding of cloud native monitoring
Technologies
Chronosphere platform, Large Language Models, Agentic AI platforms
Responsibilities
Conduct primary research with end-users and buyers to understand AI Observability needs, Partner with engineers to scope and deliver AI features, Build on the observability platform to enable testing and benchmarking of AI models, Set KPIs to measure customer value, Develop comprehensive roadmaps and delivery plans, Align teams on priorities and roadmap, Manage backlog and groom stories, Coordinate with product marketing on positioning
Seniority
Principal, hands-on IC with strategic ownership