Project Lion - Senior Prompt Engineer - Germany (Remote, Part-Time)
Core
End-to-end technical migration of templates to LLM autoraters using prompt engineering to maximize model performance.
Role type
Senior Prompt Engineer (LLM Migration & Optimization)
Builds
Production autorater systems for template clusters
Domain
AI/ML, Large Language Models, Automated Rating Systems
Deliverable
production ML models
Required skills
Prompt Engineering, LLM tuning, Chain-of-thought reasoning, Few-shot learning, Automated Prompt Generation (APG), Automated Prompt Optimization (APO), Shadowbot monitoring, Accuracy metric calculation (F1, precision, recall), Technical documentation
Preferred skills
Experience with complex template architectures, Edge case handling, Launch readiness justification
Technologies
APG tools, APO tools, Shadowbot, Gold data sets
Responsibilities
Create baseline prompts for complex parent-child template clusters using APG tools; Run and supervise Automated Prompt Optimization (APO) tools, flagging deadlocks or plateaus; Manually draft, test, and refine prompts for edge cases where tooling fails; Monitor shadowbot runs to track disagreements between human and LLM ratings; Run prompt versions against gold data to measure autorater quality and calculate accuracy metrics; Draft technical launch readiness justifications.
Seniority
Senior, hands-on IC
