Principal Technical Program Manager
Core
Define the long-term vision and roadmap for Bing's offline quality metrics ecosystem, ensuring metrics accurately predict user value and align with online outcomes for AI-powered search and agentic experiences.
Role type
Principal Technical Program Manager (Quality Metrics & Strategy)
Builds
Offline quality measurement systems, diagnostic frameworks, and investment opportunities for Bing's search and AI products.
Domain
Search, AI, Large-scale consumer experiences
Deliverable
production ML models
Required skills
Cross-functional project management, Strategic roadmap definition, Analytical problem-solving, Stakeholder management, Metrics strategy, LLM evaluation frameworks, Human rating systems, Search/retrieval systems expertise, Data analysis, Product development
Preferred skills
Experience with generative AI applications, Experience partnering with Data Science and Research organizations, Experience in ambiguous technical domains
Technologies
LLMs, Retrieval systems, Generative AI, Human rating systems
Responsibilities
Define measurement strategies for AI-powered search and ranking systems, Identify gaps in existing quality measurements, Build diagnostic frameworks for competitive gaps, Partner with Data Science and Applied Science organizations, Drive strategy in rapidly evolving technical domains
Seniority
Principal, strategy & mentorship
