Director, AI Assisted Solutions-1
Core
Lead end-to-end delivery of AI tools, prompts, and workflows to accelerate standardized assessment item development across College Board programs (SAT, AP, etc.), ensuring quality and ethical integration of AI in content creation.
Role type
Director, Applied AI Assessment Solutions (Internal Enterprise Consultancy)
Builds
AI-assisted item generation tools, agentic workflows, and content authoring system integrations for assessment programs
Domain
Education Technology / Standardized Testing / Applied AI
Deliverable
production ML models | product features
Required skills
Standardized assessment item development (7+ years), AI-assisted item generation (AIG), Retrieval-Augmented Generation (RAG), Prompt and context engineering, Agentic workflow design, Large language model failure mode diagnosis, Quality rubric creation for AI output, Change management
Preferred skills
Experience with vibe coding or rapid prototyping, Deep subject-matter expertise in Reading, Writing, Math, or Science
Technologies
Large Language Models (LLMs), Automated Item Generation (AIG), Agentic workflows
Responsibilities
Define problem requirements and design/build AI solutions for assessment programs, Evaluate AI-generated content against domain standards to catch errors and bias, Establish quality standards and evaluation criteria for AI content, Diagnose gaps and document conditions for scaling AI enablement, Design and deliver training for content teams on AI workflows, Represent program needs in cross-program discussions about shared tooling
Seniority
Director, hands-on IC with strategic engagement scope
