Senior Quantitative Analyst
Core
Establish baseline measures of transcription accuracy and annotation quality for audio-to-text datasets, identify operational bottlenecks, and build automated dashboards to monitor contributor performance and quality shifts.
Role type
Senior IC quantitative analyst (speech data quality)
Builds
Automated dashboards, scoring scripts, contributor scorecards, and control-chart alerts for speech annotation quality.
Domain
Speech recognition / Audio data annotation / Quality assurance
Deliverable
production ML models
Required skills
Statistical process control, anomaly detection, hypothesis testing, root-cause analysis, SQL, Python, R, data cleaning, sampling design, WER/CER scoring, text normalization, diarization metrics, inter-annotator agreement statistics, experience with annotation platforms (Label Studio, Labelbox, SuperAnnotate), workforce productivity analysis.
Preferred skills
Experience with speech-scoring libraries (e.g., jiwer), experience analyzing crowd or vendor-managed workforces.
Technologies
Python, SQL, Looker, Power BI, Tableau, numpy, pandas
Responsibilities
Extract, join, clean, and document data from annotation platforms, QA records, and workforce systems; establish baseline measures of transcription accuracy and throughput; apply statistical process control to identify quality shifts; analyze factors affecting audio quality and contributor performance; assess QA reliability and reviewer bias; quantify losses from rejected or reworked audio; build automated dashboards and scoring scripts; recommend QA sample sizes and alert thresholds; deliver executive-level diagnostic reports with actionable recommendations; translate findings into guideline updates and staffing decisions.
Seniority
Senior, hands-on IC
