AI Engineer 4 (LLM Gateway, FM Hosting)
Core
Design, develop, test, deploy, and support large-scale AI systems including foundation model training, LLM inference, agents, and multi-agent workflows for banking applications.
Role type
Senior IC AI Engineer (LLM Gateway & Foundation Model Hosting)
Builds
Scalable, high-performance AI infrastructure and proprietary solutions empowering Capital One's products
Domain
Financial Services / Large Language Models / Distributed Systems
Deliverable
production ML models
Required skills
Python, Go, CUDA, Java, LLM inference, foundation model optimization, distributed systems, GPU/TPU utilization, model governance
Preferred skills
Leading AI system development, agentic AI workflows, petabyte-scale distributed systems, AI model governance processes
Technologies
AWS Ultraclusters, Huggingface, VectorDBs, PyTorch
Responsibilities
Design end-to-end architecture for complex AI systems, define SLOs for AI reliability, optimize GPU/TPU utilization, lead cross-functional technical reviews, mentor Senior and Principal Associates
Seniority
Senior, hands-on IC with mentorship responsibilities
