CareerPlan

Language Measurement Scientist

Pittsburgh, PAFull-time$111k–$150k2026-11-13 → 2026-11-16
Based in United States

Core

Develop and evaluate innovative language assessments for the Duolingo English Test, ensuring tasks and scores are valid, reliable, and fair.

Role type

Senior IC language measurement scientist (assessment research)

Builds

Validated language assessment tasks, test scores, and research-driven test design

Domain

Education technology + psychometrics

Required skills

language assessment principles, test design, validity/reliability/fairness analysis, qualitative and quantitative research study design, data analysis (R/Python), technical communication

Preferred skills

large language models/NLP application to assessment, computer-adaptive test design, evidence-centered design, interactive-task development

Technologies

R, Python, large language models, NLP

Responsibilities

Collaborate with researchers and engineers to develop research-driven language assessments; Design and evaluate assessment tasks including new interactive item formats; Conduct studies examining validity, reliability, and fairness of test scores; Translate research findings into recommendations for technical and non-technical partners; Share findings through reports, publications, and presentations

Seniority

Senior, hands-on IC