Data Scientist
Core
Independently test, challenge, and validate machine learning, Generative AI, and agentic AI use cases to ensure safe and sustainable AI adoption.
Role type
Senior IC Data Scientist (AI Model Validation)
Builds
Reusable evaluations, test harnesses, and automation for AI validation at scale
Domain
Artificial Intelligence / Generative AI / Model Validation
Deliverable
production ML models
Required skills
Advanced Python, Generative AI architectures, Agentic systems, RAG pipelines, Test harness design, Synthetic data generation, Transformer fine-tuning, Traditional ML evaluation
Preferred skills
LangChain, LangGraph, OpenAI Agents SDK, Pydantic, Langfuse, HoneyHive, AI coding agents (Claude Code/Codex), XGBoost, Random Forests
Technologies
Python, GitHub, CI/CD, SQL, R, TypeScript, LangChain, LangGraph, OpenAI Agents SDK, Pydantic, Langfuse, HoneyHive, Claude Code, Codex, XGBoost
Responsibilities
Independently deliver technical analysis, testing, and evaluation of AI/ML models; Review data, methodologies, assumptions, and model outcomes; Design and execute evaluations for Generative AI and agentic systems; Build reproducible test harnesses and automation; Navigate unfamiliar codebases and inspect trace data; Provide evidence-based technical challenge to stakeholders
Seniority
Senior, hands-on IC
