Psychometrician, AWS Training & Certification
Core
Design, develop, and analyze large-scale certification exams for AWS using psychometric methods and statistical modeling to ensure validity, reliability, and accuracy.
Role type
Senior psychometrician (certification exam development)
Builds
Validated certification exams and credentialing programs for AWS
Domain
Education technology / Cloud computing certification
Deliverable
production ML models | product features
Required skills
Psychometric analysis, Item Response Theory (IRT), Classical Test Theory, Standard setting, Job Task Analysis (JTA), Automated test assembly, Statistical modeling, Machine Learning (ML), Natural Language Processing (NLP), Programming in R or Python
Preferred skills
Data forensics, Global audience testing experience, Conference presentations and publications
Technologies
R, Python, Machine Learning, NLP, Generative AI
Responsibilities
Perform item analysis and build optimal test forms using optimization techniques; Conduct standard setting studies to define pass standards; Develop automation code for psychometric workflow pipelines; Participate in research projects to improve operational processes using ML and NLP; Present and communicate analysis results to stakeholders.
Seniority
Senior, hands-on IC
