Prompt Engineer (LLMs & AI Evaluation)
Core
Senior Prompt Engineer designing, refining, and evaluating advanced prompts for Generative AI models to optimize business interactions and model selection.
Role type
Senior IC Prompt Engineer (LLMs & AI Evaluation)
Builds
Production prompt solutions and evaluation frameworks for Generative AI
Domain
Generative AI / Large Language Models (LLMs)
Deliverable
production ML models
Required skills
Prompt Engineering, LLM evaluation, Python (advanced), few-shot prompting, Chain of Thought Prompting, Structured Prompting, A/B testing, script automation
Preferred skills
Experience with Generative AI projects, Agile environments, collaboration with business units
Technologies
Python, LLMs
Responsibilities
Design and optimize prompts for business use cases, refine existing prompts for precision and quality, collaborate with functional teams to translate business needs into AI solutions, analyze results from different LLMs, define evaluation methodologies, conduct A/B tests of prompts, evaluate LLMs using standardized prompts, document findings and best practices, automate testing and evaluations via scripts, participate in international sessions in English
Seniority
Senior, hands-on IC
