AI Engineer 5 (AI Foundations, LLM Core and Agentic AI)
Core
Design, develop, test, deploy, and support foundational AI systems including LLM training, inference, agentic workflows, and multi-model orchestration to enhance banking products.
Role type
Senior IC AI Engineer (LLM Core & Agentic AI)
Builds
Proprietary AI platforms and production systems for Capital One's banking customers and internal associates.
Domain
Financial Services / Large Language Models / AI Infrastructure
Deliverable
production ML models
Required skills
Foundation model training, LLM inference, agentic workflows, multi-model orchestration, model optimization, cost-performance governance, Python, Go, CUDA, Java, PyTorch, VectorDBs, AWS Ultraclusters
Preferred skills
Leading development of AI systems with tradeoff decisions, deploying scalable AI on cloud platforms, building agentic AI systems, architecting heterogeneous AI systems, enforcing ethical AI standards, dynamic inference strategies, model compression, right-sizing models
Technologies
AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, CUDA, Python, Go, Scala, Java, C++, C#
Responsibilities
Design and implement multi-model orchestration pipelines integrating LLMs and vector search; Lead cost-performance governance reviews tracking GPU utilization and inference costs; Mentor Principal and Manager-level AI engineers; Contribute to the technical vision and roadmap of foundational AI systems; Establish design review boards for technical consistency
Seniority
Senior, hands-on IC with mentorship responsibilities
