Staff Research Engineer/Scientist
Core
Design and architect data infrastructure and pipelines to support agentic AI workflows, including defining evaluation metrics, building automated evaluation pipelines, and establishing data quality standards.
Role type
Staff Research Engineer/Scientist (Data Infrastructure & AI Evaluation)
Builds
Automated evaluation infrastructure, data pipelines, and ground truth datasets for agentic AI systems.
Domain
Enterprise AI / Agentic Workflows / Data Engineering
Deliverable
production ML models
Required skills
Data pipeline architecture, SQL, Python, distributed data processing, ML system validation, data quality engineering, cloud platforms (GCP/AWS), agentic workflow evaluation, LLM instrumentation.
Preferred skills
ServiceNow platform experience, AI/ML evaluation frameworks.
Responsibilities
Design data architecture and pipelines for structured/unstructured data; develop tools for data transformation and cleansing; define evaluation metrics and ground truth for agentic workflows; build automated evaluation pipelines using LLM service models; establish design standards and quality assurance processes; mentor junior engineers on data engineering and evaluation design.
Seniority
Staff, hands-on IC with mentorship responsibilities.
