Language Measurement Scientist
Core
Develop and evaluate innovative language assessments for the Duolingo English Test, ensuring tasks and scores are valid, reliable, and fair.
Role type
Senior IC language measurement scientist (assessment research)
Builds
Validated language assessment tasks, test scores, and research-driven test design
Domain
Education technology + psychometrics
Required skills
language assessment principles, test design, validity/reliability/fairness analysis, qualitative and quantitative research study design, data analysis (R/Python), technical communication
Preferred skills
large language models/NLP application to assessment, computer-adaptive test design, evidence-centered design, interactive-task development
Technologies
R, Python, large language models, NLP
Responsibilities
Collaborate with researchers and engineers to develop research-driven language assessments; Design and evaluate assessment tasks including new interactive item formats; Conduct studies examining validity, reliability, and fairness of test scores; Translate research findings into recommendations for technical and non-technical partners; Share findings through reports, publications, and presentations
Seniority
Senior, hands-on IC