Project Lion - Senior Prompt Engineer - Spain (Remote, Part-Time)
Core
Design and optimize prompts for LLM autoraters to transition templates and maximize model performance in complex classification tasks.
Role type
Senior Prompt Engineer (LLM optimization)
Builds
LLM autorater systems for template migration
Domain
AI / Large Language Models / Prompt Engineering
Deliverable
production ML models
Required skills
Prompt engineering, LLM tuning, chain-of-thought reasoning, few-shot learning, structured output design, accuracy metric analysis (F1, precision, recall), automated prompt generation, edge case handling
Preferred skills
None stated
Technologies
Automatic Prompt Generation (APG) tools, Automated Prompt Optimization (APO) tools, shadowbot systems
Responsibilities
Create baseline prompts for complex template clusters using APG tools; Run and supervise APO tools to resolve deadlocks; Manually draft and refine prompts for edge cases; Monitor shadowbot runs to track human-LLM disagreements; Evaluate autorater quality against gold data using accuracy metrics; Draft technical launch readiness documentation
Seniority
Senior, hands-on IC
