Senior Software Engineer, Core Infrastructure
Core
Design and build scalable, fault-tolerant infrastructure systems powering Harvey's global legal AI platform, handling billions of prompt tokens and millions of daily requests.
Role type
Senior IC Infrastructure Engineer (Platform/Cloud)
Builds
Multi-cloud infrastructure (Azure/GCP), Kubernetes orchestration, observability systems, CI/CD pipelines, and distributed rate limiting/quota management.
Domain
Legal Tech / AI Infrastructure / Cloud Engineering
Deliverable
infrastructure
Required skills
Distributed systems design, Cloud infrastructure (Azure/GCP), Kubernetes orchestration, Infrastructure as Code (Terraform/Pulumi), Observability engineering, Incident response, Python/Go programming
Preferred skills
AI/ML workload infrastructure, High-throughput inference systems, Multi-tenant platform operations, Cross-functional technical leadership
Technologies
Azure, GCP, Kubernetes, Terraform, Pulumi, Datadog, Sentry, PagerDuty, Redis
Responsibilities
Design scalable fault-tolerant systems, Own multi-cloud infrastructure evolution, Lead observability and incident response initiatives, Architect distributed systems for reliability, Partner with Product/Security teams, Mentor engineers and raise technical bar
Seniority
Senior, hands-on IC with mentorship responsibilities
