Member of Technical Staff, AI Developer Experience
Core
Build internal systems and tooling to enable the team to develop, evaluate, and ship AI features quickly and reliably for an AI-native law firm.
Role type
Senior IC platform engineer (AI developer experience)
Builds
Internal developer tooling for prompt management, evaluation, experimentation, and model iteration
Domain
Legal technology + AI infrastructure
Deliverable
production ML models | infrastructure
Required skills
Python, backend systems design, LLM APIs, experimentation frameworks, data pipelines, systems thinking
Preferred skills
Developer tooling experience, platform team experience, pragmatic problem solving
Technologies
Python, OpenAI, Anthropic
Responsibilities
Design and implement internal tools for prompt management, evaluation, and model iteration; Create systems for rapid testing, debugging, and comparison of model outputs; Develop frameworks for benchmarking, regression testing, and monitoring AI system performance; Build pipelines for data collection, labeling, and feedback loops; Partner with engineering teams to ensure AI features are reliable and observable in production; Identify bottlenecks and build systems to increase developer velocity
Seniority
Senior, hands-on IC