Research and Evaluations Lead (1053) - Department of Technology
Core
Lead research and evaluation of AI and emerging technology tools to guide staff enablement, tool prioritization, and responsible adoption across the City of San Francisco.
Role type
Senior Research and Evaluation Lead (Emerging Technologies)
Builds
Practical recommendations for tool procurement, pilots, and staff training programs
Domain
Public sector / Civic technology / Artificial Intelligence
Deliverable
Dashboards & analysis
Required skills
Qualitative user research, quantitative evaluation, mixed-methods research, program evaluation design, training needs assessment, data analysis, stakeholder communication
Preferred skills
Experimental design (A/B tests, quasi-experimental), SQL, R, Python, academic partnership management
Technologies
Qualtrics, Fillout, Excel, Sheets, SQL, R, Python
Responsibilities
Conduct qualitative and quantitative research on staff AI tool usage and adoption barriers; Translate research findings into prioritized input for tool builds and procurements; Assess staff training needs and recommend upskilling approaches; Design and run evaluations of emerging technology tools including experiments; Pair usage-log data with survey responses to measure outcomes; Support City capacity for rigorous pilot evaluations through partnerships
Seniority
Senior, hands-on IC