Applied Data Researcher
Core
Identify and vet opportunities, lead investigations, and build Data products, tools, and prototypes to evaluate generative AI and agentic workflows using petabyte-scale datasets.
Role type
Senior Applied Data Researcher (Generative AI Evaluation)
Builds
LLM-powered tools, agentic workflows, models, prototypes, and evaluation systems
Domain
Generative AI, Machine Learning, Data Science, Product Development
Deliverable
production ML models
Required skills
Machine learning, statistics, causal inference, generative AI evaluation, Python, SQL, software engineering, technical leadership, strategic prioritization
Preferred skills
Human labeling, automated judge validation, conversational data, multimodal AI, interactive application development, cloud/data infrastructure (Snowflake, AWS, Dagster, dbt, Hex)
Technologies
Python, SQL, Snowflake, AWS, Dagster, dbt, Hex
Responsibilities
Identify and vet consequential opportunities across Data products and AI measurement; Develop and validate methods for evaluating generative AI and agentic workflows; Personally write code and build or adapt LLM-powered tools and prototypes; Provide technical direction and mentor scientists and engineers; Independently drive delivery of prototypes into maintained systems; Establish reusable methods, tools, and technical standards
Seniority
Senior, hands-on IC with leadership responsibilities
