Staff Software Engineer, Core Infrastructure
Core
Design and build scalable, fault-tolerant infrastructure systems powering Harvey's AI platform, handling billions of prompt tokens and millions of daily requests across global regions.
Role type
Staff Software Engineer (Core Infrastructure)
Builds
Multi-cloud infrastructure (Azure, GCP), Kubernetes orchestration, distributed systems, observability pipelines, and CI/CD systems.
Domain
Cloud Infrastructure / AI Platform Engineering
Deliverable
infrastructure
Required skills
Distributed systems design, Cloud infrastructure (Azure/GCP), Kubernetes orchestration, Infrastructure as Code (Terraform/Pulumi), Observability engineering, Incident response, Python/Go programming
Preferred skills
AI/ML workload infrastructure, Distributed rate limiting, Multi-tenant platform operations
Technologies
Azure, GCP, Kubernetes, Terraform, Pulumi, Datadog, Sentry, PagerDuty, Redis
Responsibilities
Design scalable fault-tolerant systems, Own multi-cloud infrastructure evolution, Lead observability and incident response initiatives, Architect distributed systems for reliability, Partner with Product Engineering and Security, Mentor engineers and raise technical bar
Seniority
Staff, hands-on IC with strategic leadership
