Sr. Psychometrician, Data Center Certifications
Core
Measurement science backbone for AWS data center certification programs, ensuring assessments are valid, reliable, fair, and defensible for workforce capability validation.
Role type
Senior individual contributor psychometrician (certification design)
Builds
Outcome-based certifications for AWS data center builders using practical and simulated environments
Domain
Workforce credentialing + psychometrics + data center operations
Deliverable
production ML models | product features | dashboards & analysis | research | client delivery | infrastructure | physical/clinical work
Required skills
psychometric design and validation, Job Task Analysis (JTA) facilitation, classical test theory (CTT), item response theory (IRT), standard-setting methodologies (Angoff, Bookmark), bias and DIF analysis, statistical software (R, Stata, Python), vendor management
Preferred skills
Ph.D. in quantitative fields, technical workforce credentialing experience, performance-based assessment design, global distributed environment management
Technologies
R, Stata, Python
Responsibilities
Lead psychometric design and validation of certification assessments, design and audit scalable Job Task Analyses, apply CTT and IRT to evaluate item quality, develop and govern item development workflows, analyze assessment data for bias and reliability, maintain independence between training and certification, build psychometric reporting frameworks, partner with third-party assessment vendors
Seniority
Senior, hands-on IC with significant influence over program strategy
