CareerPlan

Vice President, AI Engineer

New York, NY, USFull-time2026-10-20 → 2026-11-10

Core

Design, build, and operate production-grade AI platform services and reusable components to enable enterprise Generative AI use cases across the organization.

Role type

Senior IC Vice President, AI Platform Engineering

Builds

Reusable AI platform services, multi-LLM gateways, RAG services, orchestration tools, and developer tooling for internal AI applications

Domain

Financial services / Generative AI / Machine Learning Platform Engineering

Deliverable

production ML models

Required skills

Generative AI and LLM system design, Python software engineering, API and microservices architecture, cloud-native development, Kubernetes and container orchestration, CI/CD pipeline design, vector database integration, prompt engineering, model evaluation and observability, security and access control implementation

Preferred skills

Databricks (Delta Lake, Unity Catalog, MLflow), Azure OpenAI services, LLM agent frameworks (LangGraph, LangChain, AutoGen), multi-LLM gateway patterns

Technologies

Python, Kubernetes, Azure, Vector Databases, LangGraph, LangChain, AutoGen, MCP

Responsibilities

Design and implement multi-LLM gateway capabilities with routing and cost management; Develop Retrieval-Augmented Generation services including embeddings and semantic search; Build reusable orchestration services for agentic and multi-step AI workflows; Establish CI/CD pipelines and operational monitoring for AI applications; Partner with security and compliance teams to implement authentication, authorization, and governance controls; Provide technical mentorship and guidance to AI engineering teams

Seniority

Senior, hands-on IC with leadership responsibilities