Principal Product Manager
Core
Define post-training priorities and evaluation strategies for large language models by bridging user feedback, research insights, and production incidents to drive fine-tuning and RLHF cycles.
Role type
Principal Product Manager (Applied AI/LLM)
Builds
Post-training pipelines, RLHF data campaigns, and behavior evaluation frameworks for generative AI models.
Domain
Artificial Intelligence / Large Language Models / Responsible AI
Deliverable
production ML models
Required skills
Product strategy, RLHF cycle management, qualitative-to-quantitative translation, stakeholder alignment, market disruption, metric improvement, go-to-market execution.
Preferred skills
None stated.
Technologies
None stated.
Responsibilities
Embed in post-training loops to review model outputs and provide structured feedback on quality, tone, and behavior; partner with data teams to scope human preference data collection; build and maintain behavior evaluation sets; translate user research and incident learnings into concrete post-training priorities; drive alignment on tuning tradeoffs (helpfulness vs. caution, latency vs. quality); represent Responsible AI and enterprise requirements in training priorities.
Seniority
Principal, strategy & mentorship