CareerPlanSign in

Senior Data Scientist

The position is based onsite in New York City, five days per week, giving you th💼 Full-time💰 $180,000–$180,000🗓 2026-09-28

Core

Lead measurement and modeling for an agentic platform from 0→1, defining agent quality, reliability, and unit economics.

Role type

Senior IC data scientist (LLM/agent evaluation & experimentation)

Builds

Evaluation frameworks, experimentation infrastructure, and analytics for agentic workflows

Domain

AI/LLM operations, supply chain, industrial staffing

Deliverable

production ML models

Required skills

Python, SQL, statistical inference, causal methods, LLM evaluation, experiment design (A/B testing), data warehousing, data governance

Preferred skills

Jupyter, dbt, internal agent/MCP server development, LLM fine-tuning/distillation, vertical AI company experience

Technologies

scikit-learn, PyTorch, pandas, statsmodels, Langfuse, Braintrust

Responsibilities

Design metrics and models for agent quality/reliability/economics; build evaluation/experimentation discipline; architect scalable analytics infrastructure; oversee data warehouse development; mentor data science team

Seniority

Senior, hands-on IC with mentorship responsibilities

Sourced via wellfound · Listed on CareerPlan, which tracks 845,000+ jobs from 20+ sources.