Research Engineer - Evals
Core
Design metrics, build pipelines, and generate datasets to rigorously evaluate the quality of Firecrawl's web-to-data conversion system.
Role type
Research Engineer specializing in evaluation systems (Evals)
Builds
Evaluation pipelines and datasets for measuring LLM-ready data extraction quality
Domain
AI infrastructure / Web data extraction / Evaluation metrics
Deliverable
production ML models
Required skills
metric design, pipeline engineering, dataset curation, feedback loop implementation, ambiguity resolution, rapid iteration
Preferred skills
deep engineering knowledge, methodological thinking, ownership of undefined problems
Technologies
(not explicitly listed)
Responsibilities
Design metrics defining 'good output' across millions of sites, build pipelines to measure quality at scale, generate and curate evaluation datasets, own the feedback loop from output quality to model/product decisions
Seniority
Senior, hands-on IC
