Senior | Staff Software Engineer - AI / ML
Core
Build faster, cheaper, and more rigorous ML evaluation systems for frontier AI agents and models.
Role type
Senior Staff Software Engineer (AI/ML)
Builds
Adaptive sampling systems, AI model routing gateways, fine-tuned small models, predictive difficulty estimators, and golden datasets for AI evaluation.
Domain
Frontier AI, LLM evaluation, Agentic AI systems
Deliverable
production ML models
Required skills
Python, system design, statistics, experiment design, hypothesis testing, sampling, confidence intervals, LLM/ML workload management, non-deterministic system reasoning, evaluation design
Preferred skills
Fine-tuning open-weight models (LoRA), building LLM evaluation platforms, agentic workloads, RL environments, research-to-production track record
Technologies
Python, LoRA, LLMs
Responsibilities
Design adaptive sampling and early stopping strategies for long-horizon agent evaluations; Build model routing systems to optimize cost and quality; Fine-tune and serve parameter-efficient models; Develop predictive models for task difficulty; Create golden datasets and quantify LLM-as-judge accuracy; Convert research prototypes into reusable production components.
Seniority
Senior, hands-on IC with strategic impact