Senior Software Engineer, AI Platform
Core
Building the shared AI foundation (model layer, agent infrastructure, context management) that powers Harvey's agentic products for legal and professional services.
Role type
Senior Staff IC backend engineer specializing in AI platform infrastructure
Builds
Model routing systems, agent architecture, context management platforms, and shared evaluation tooling
Domain
Legal tech / Agentic AI infrastructure
Deliverable
production ML models | infrastructure
Required skills
backend systems design, multi-model AI system architecture, context/session state management, internal platform/SDK development, evaluation framework design, agentic system integration
Preferred skills
experience with function-calling architectures, legal domain knowledge, early-stage startup environment
Technologies
LLMs, agent frameworks, distributed systems, SDKs
Responsibilities
Design platform-level abstractions for agentic products, own model integration and routing infrastructure, build evaluation frameworks for AI quality, partner with product teams to launch AI features, prototype emerging AI advancements
Seniority
Senior/Staff, hands-on IC with technical leadership