CareerPlan

AI Engineer 5 (Gen AI SDK: Agentic AI, Guardrails, Evaluation)

New York, NY, USFull-time$230k–$286k2026-10-16 → 2026-11-11
Based in United StatesVisa sponsorship offered

Core

Design, develop, test, deploy, and support Gen AI SDK components including agentic AI workflows, guardrails, model evaluation, and multi-model orchestration for banking applications.

Role type

Senior IC AI Engineer (Gen AI SDK)

Builds

Proprietary Gen AI SDKs, agentic workflows, and scalable AI infrastructure for Capital One's banking products.

Domain

Financial Services / Generative AI / Large Language Models

Deliverable

production ML models

Required skills

Python, Go, CUDA, Java, LLM inference, vector search, guardrails, model evaluation, multi-agent orchestration, system optimization, cost-performance governance

Preferred skills

Leading AI system development, cloud platform deployment (AWS/GCP/Azure), agentic AI system design, heterogeneous AI system architecture, ethical AI standards, dynamic inference strategies, model compression

Technologies

AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, CUDA

Responsibilities

Partner with cross-functional teams to deliver AI-powered products; Design and optimize multi-model orchestration pipelines; Establish cost-performance governance reviews; Lead design councils for technical consistency; Mentor Principal and Manager-level engineers

Seniority

Senior, hands-on IC with mentorship responsibilities