Program Analyst Sr – Generative AI, Prompt Engineering & Validation
Core
Program Analyst supporting Generative AI initiatives focused on prompt engineering, feature validation, test execution, output quality evaluation, and program tracking for internal GenAI platforms.
Role type
Senior Program Analyst (Generative AI)
Builds
Internal GenAI platforms, tools, and validation frameworks for search, summarization, RAG-based workflows, and analytical agents.
Domain
Generative AI, Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), Prompt Engineering
Deliverable
production ML models
Required skills
Program coordination, prompt engineering, structured test design, output quality evaluation, data validation, defect analysis, stakeholder reporting, automation support
Preferred skills
Python, SQL, Power BI, Jira, Confluence, SharePoint, semiconductor industry experience
Technologies
LLMs, RAG, SharePoint, Confluence, Jira, Excel, Power BI
Responsibilities
Track GenAI feature validation plans and deliverables; Create and refine prompts for GenAI features; Design and execute structured test cases for GenAI features; Validate AI outputs against data sources; Evaluate GenAI responses for factual correctness and consistency; Prepare weekly validation summaries and executive reports; Support basic scripting for batch prompt execution and reporting.
Seniority
Senior, hands-on IC