AI Engineer 5
Core
Design, develop, test, deploy, and support large-scale production AI systems, including foundation model training, LLM inference, multi-agent workflows, and multi-model orchestration pipelines for banking applications.
Role type
Senior IC AI Engineer (Foundation Models & Infrastructure)
Builds
Scalable, high-performance AI infrastructure and proprietary solutions empowering teams across Capital One to enhance products with AI.
Domain
Financial Services / Applied AI & Machine Learning
Deliverable
production ML models
Required skills
Python, Go, Scala, CUDA, Java, PyTorch, VectorDBs, LLM Inference, Multi-agent workflows, Model optimization, GPU utilization management, System architecture
Preferred skills
Agentic AI systems design, Heterogeneous AI system integration, Ethical AI deployment standards, Model compression, Dynamic inference strategies, Cloud platform deployment (AWS/GCP/Azure)
Technologies
AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, CUDA
Responsibilities
Design and implement multi-model orchestration pipelines integrating LLMs and vector search; Lead cost-performance governance reviews tracking GPU utilization and inference costs; Mentor Principal and Manager-level AI engineers; Contribute to the technical vision and long-term roadmap of foundational AI systems.
Seniority
Senior, hands-on IC with mentorship responsibilities