Staff Data Engineer
Core
Design and architect data infrastructure and pipelines to support agentic AI workflows, including evaluation metrics, ground truth labeling, and automated performance measurement.
Role type
Staff Data Engineer (Agentic AI Evaluation)
Builds
Automated evaluation pipelines, data quality frameworks, and dashboards for AI agent performance using Now LLM Service models.
Domain
AI/ML evaluation, Data Engineering, Agentic Workflows
Deliverable
production ML models | infrastructure
Required skills
Data pipeline architecture, ETL/ELT, SQL, Python, Distributed data processing, Data quality management, Cloud platforms (GCP/AWS), Event-driven systems, AI/ML evaluation frameworks, LLM instrumentation
Preferred skills
ServiceNow platform experience, Agentic workflow design, Model monitoring
Technologies
Now LLM Service, GCP, AWS, SQL, Python, Javascript
Responsibilities
Design and oversee deployment of data architecture and pipelines; Develop technical tools to cleanse and transform data; Define evaluation metrics and ground truth for agentic workflows; Implement automated evaluation infrastructure; Create design standards and quality assurance processes; Mentor junior engineers on data engineering and evaluation design.
Seniority
Staff, hands-on IC with mentorship
