Psychometrician, AWS Training & Certification
Core
Design, develop, and validate high-stakes certification exams and credentialing programs using psychometric methods.
Role type
Senior psychometrician (certification program)
Builds
Validated exam blueprints, item banks, and credentialing standards for AWS certifications
Domain
Education + Cloud computing certification
Deliverable
production ML models | product features | dashboards & analysis | research | client delivery
Required skills
Job task analysis, standard setting, item response theory, equating, automated test assembly, R, Python, Generative AI tools
Preferred skills
Global testing experience, Computerized Adaptive Testing (CAT), data forensics, advanced AI methods (Machine Learning, Agentic AI)
Technologies
R, Python, Generative AI tools
Responsibilities
Conduct Job Task Analysis (JTA) workshops and survey analyses to define exam blueprints; Conduct standard setting studies to establish passing scores; Run item analysis to evaluate exam item quality; Use automated test assembly procedures to create exam forms; Optimize item bank health and trends; Support development of cloud-based analytics systems; Interpret and communicate analysis results to stakeholders; Ensure compliance with ISO/IEC 17024 and NCCA accreditation standards.
Seniority
Senior, hands-on IC