Applied AI Data Analyst
Core
Bridge unstructured financial/operational datasets to R&D teams and own evaluation platforms for agentic workflows and forecasting pipelines.
Role type
Applied AI Data Analyst (IC)
Builds
Evaluation platforms for agentic workflows, forecasting pipelines, and customer-facing insights.
Domain
Consumer Packaged Goods (CPG) + AI/ML Evaluation
Deliverable
production ML models
Required skills
Python, SQL, PostgreSQL, Snowflake, dbt, AWS, LLM evaluation, root cause analysis, dataset curation, performance monitoring
Preferred skills
LLM observability/tracing, agentic workflows, multi-agent orchestration, demand forecasting, time-series modeling
Technologies
LangSmith, Arize AI, TruLens
Responsibilities
Analyze edge cases, hallucination rates, and extraction accuracy for LLM-driven systems; Dig into complex datasets to determine model success/failure; Define and maintain gold-standard evaluation datasets; Build dashboards and evaluation harnesses to monitor system health and model drift; Partner with engineers and product managers to translate problem definitions into quantitative insights.
Seniority
Mid-level, hands-on IC
