CareerPlan

Director, AI Assisted Solutions-1

Remote - USARemoteFull-time2026-09-25 → 2026-11-16
Hybrid · United States

Core

Lead end-to-end delivery of AI tools, prompts, and workflows to accelerate standardized assessment item development across College Board programs (SAT, AP, etc.), ensuring quality and ethical integration of AI in content creation.

Role type

Director, Applied AI Assessment Solutions (Internal Enterprise Consultancy)

Builds

AI-assisted item generation tools, agentic workflows, and content authoring system integrations for assessment programs

Domain

Education Technology / Standardized Testing / Applied AI

Deliverable

production ML models

Required skills

Standardized assessment item development (7+ years), AI-assisted item generation (AIG), Retrieval-Augmented Generation (RAG), Prompt and context engineering, Agentic workflow design, Large language model failure mode diagnosis, Quality rubric creation for AI output, Change management

Preferred skills

Experience with vibe coding or rapid prototyping, Deep subject matter expertise in Reading, Writing, Math, or Science

Technologies

LLMs, AIG, RAG, Agentic workflows

Responsibilities

Define problem requirements and design/build AI solutions for assessment programs; Evaluate AI-generated content against domain standards to catch bias and errors; Establish quality standards and evaluation criteria for AI content; Identify requirements for systems-based solutions; Diagnose gaps for scaling AI enablement; Design and deliver training for content teams on AI workflows; Document processes and impact metrics for AI adoption.

Seniority

Director, hands-on IC with strategic engagement scope