CareerPlan

AI Engineer 4 (Gen AI Platform Services)

New York, NY, USFull-time$197k–$246k2026-09-24 → 2026-11-11
Based in United StatesVisa sponsorship offered

Core

Design, develop, test, deploy, and support large-scale Gen AI systems, including foundation model training, LLM inference, agents, and multi-agent workflows for banking applications.

Role type

Senior IC AI Engineer (Gen AI Platform Services)

Builds

Proprietary AI platforms and services that empower Capital One teams to enhance products with responsible, scalable AI.

Domain

Financial Services / Generative AI / Large Language Models

Deliverable

production ML models

Required skills

Python, Go, Scala, CUDA, Java, foundation model training, LLM inference, agent workflows, similarity search, vector databases, model optimization, distributed systems, GPU/TPU utilization, SLO definition, technical mentorship

Preferred skills

Leading AI system development with cost/latency tradeoffs, deploying scalable AI on cloud platforms, building agentic AI systems, designing petabyte-scale distributed systems, AI model governance processes

Technologies

AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, CUDA, Golang, C++, C#, Java

Responsibilities

Partner with cross-functional teams to deliver AI-powered products; Invent and introduce state-of-the-art foundation model optimization techniques; Own end-to-end architecture for complex AI systems; Collaborate with infrastructure engineering to optimize GPU/TPU utilization; Lead cross-functional technical reviews for new AI system deployments; Mentor Principal and Senior Associates on scalable design and research-to-production translation

Seniority

Senior, hands-on IC with mentorship responsibilities