Principal Product Manager - AI Observability (Chronosphere)
Core
Lead the development of AI Observability and Evaluation features for developers to measure the accuracy, relevance, performance, and safety of AI models, agents, and RAG applications.
Role type
Principal Product Manager (AI Observability)
Builds
AI Observability and Evaluation features for the Chronosphere platform
Domain
Cybersecurity / AI / Cloud Native Observability
Deliverable
product features
Required skills
Enterprise software product management, Machine Learning and Foundational Model product experience, Large Language Model quality metrics (entropy, cross entropy, perplexity), AI Observability and Evaluation methodologies, Cloud native monitoring, SaaS operations, Agile processes
Preferred skills
Experience with major models and agent platforms, Deep understanding of cloud native monitoring
Technologies
Large Language Models, RAG applications, Cloud native monitoring tools
Responsibilities
Conduct primary research with end-users and buyers to understand AI Observability needs, Partner with engineers to scope and deliver integrated features, Build on the observability platform to enable testing and benchmarking of AI models, Set KPIs to measure value and impact, Develop comprehensive roadmaps and delivery plans, Align teams on priorities and roadmap, Manage backlog and groom stories, Coordinate with product marketing on positioning
Seniority
Principal, hands-on IC with strategic leadership
