Senior Data Scientist
Core
Lead measurement and modeling for an agentic platform from 0→1, defining agent quality, reliability, and unit economics.
Role type
Senior IC data scientist (LLM/agent evaluation & experimentation)
Builds
Evaluation frameworks, experimentation infrastructure, and analytics for agentic workflows
Domain
AI/LLM operations, supply chain, industrial staffing
Deliverable
production ML models
Required skills
Python, SQL, statistical inference, causal methods, LLM evaluation, experiment design (A/B testing), data warehousing, data governance
Preferred skills
Jupyter, dbt, internal agent/MCP server development, LLM fine-tuning/distillation, vertical AI company experience
Technologies
scikit-learn, PyTorch, pandas, statsmodels, Langfuse, Braintrust
Responsibilities
Design metrics and models for agent quality/reliability/economics; build evaluation/experimentation discipline; architect scalable analytics infrastructure; oversee data warehouse development; mentor data science team
Seniority
Senior, hands-on IC with mentorship responsibilities