Engineering Manager, Model Infrastructure
Core
Lead the team building the platform powering every model request, evolving from operating third-party models to training, evaluating, and deploying Harvey's own frontier AI models.
Role type
Senior Engineering Manager, Model Infrastructure
Builds
Unified Model Controller (UMC), Model Selector, multi-provider model platform, data pipelines, and training environments
Domain
AI Infrastructure / LLM Operations / Cloud Systems
Deliverable
production ML models | infrastructure
Required skills
software engineering leadership, distributed systems architecture, cloud infrastructure management, high-availability system operations, platform scalability, observability, cost optimization, cross-functional leadership, team building
Preferred skills
AI infrastructure, LLM serving, machine learning platforms, multi-provider model integration, Kubernetes, GPU infrastructure, data platforms (Spark, Kafka, Flink, Airflow, Iceberg)
Technologies
Kubernetes, Spark, Kafka, Flink, Airflow, Iceberg, OpenAI, Anthropic, Azure OpenAI, Fireworks, Baseten
Responsibilities
Define technical roadmap for model reliability and scalability; build systems for model provisioning, capacity management, and failover; own multi-provider model platform integrations; drive evolution of UMC and Model Selector; improve observability and cost reporting; partner on model launches and capacity planning; build infrastructure for future model training; recruit and mentor engineering talent
Seniority
Senior, hands-on IC with management responsibilities
