Research Engineer
Core
Build and maintain evaluation infrastructure and data pipelines for AI-powered user interviews and digital twin research systems.
Role type
Senior IC research engineer (LLM evaluation & data infrastructure)
Builds
Digital twin research systems and evaluation infrastructure for AI-powered user interviews
Domain
AI research / Computational social science / Large Language Models
Deliverable
production ML models
Required skills
Python, large-scale data pipelines, cloud infrastructure, concurrent job execution, machine learning fundamentals, transformer-based language models, deterministic code, Git workflows, SQL, database management
Preferred skills
LLM system engineering, fine-tuning open-weight models, vLLM/SGLang inference frameworks, experiment tracking, GPU provisioning, survey/panel data platforms, model activation extraction, generative agents/digital twins
Technologies
Python, SQL, Git, vLLM, SGLang, multi-GPU hardware, cloud providers
Responsibilities
Own evaluation infrastructure for testing modeling approaches; implement measurement pipelines with deterministic outputs; maintain versioned evaluation datasets; build data pipelines for human-participant and model training data; keep research code aligned with production; detect evaluation validity threats; track compute and API spend; manage repositories and reproducibility; propose efficiency improvements
Seniority
Senior, hands-on IC