CareerPlan

Sr. Manager, AI Engineer (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation)

New York, NY, USFull-time$230k–$286k2026-11-03 → 2026-11-10
Visa sponsorship offered

Core

Lead the design, development, and deployment of Gen AI platform services including agentic AI, guardrails, and model evaluation for Capital One's banking products.

Role type

Senior Manager, hands-on IC leading AI engineering

Builds

Proprietary Gen AI solutions (LLM inference, vector search, agentic workflows) for internal associates and external customers

Domain

Financial Services / Generative AI / Large Language Models

Deliverable

production ML models

Required skills

AI/ML algorithm development, LLM inference, agentic AI systems, model evaluation, cloud platform deployment (AWS/GCP/Azure), Python/C++/Java/CUDA/Golang, team leadership, technical strategy, MLOps, hardware optimization

Preferred skills

Managing multi-disciplinary AI teams, building agentic workflows, applying novel research to production, mentoring engineers, right-sizing models and hardware

Technologies

AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, CUDA, Golang, Python, C++, C#, Java

Responsibilities

Partner with cross-functional teams to deliver AI-powered products; oversee design and deployment of AI components; make build-vs-buy decisions; optimize foundation model performance; define technical vision and roadmap; attract and retain top talent; operationalize Responsible AI standards; collaborate with Research and Data teams

Seniority

Senior, hands-on IC with people leadership