Lead AI Engineer (AI Foundations)
Core
Building responsible, scalable AI infrastructure and deploying foundation models (LLMs) to transform banking experiences for customers and associates.
Role type
Lead AI Engineer (AI Foundations)
Builds
Proprietary AI platforms, foundation model training pipelines, and large-scale inference systems for Capital One.
Domain
Banking / Applied AI & Machine Learning
Deliverable
production ML models
Required skills
Python, Go, Scala, Java, C++, C#, LLM inference, similarity search, vector databases, model optimization, system design, hardware/software optimization
Preferred skills
Cloud platform deployment (AWS/GCP/Azure), AI service architecture, training/inference software optimization, state-of-the-art research application
Technologies
AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch
Responsibilities
Partner with cross-functional teams to deliver AI-powered products; Design, develop, test, deploy, and support AI software components including foundation model training and LLM inference; Invent and introduce state-of-the-art LLM optimization techniques; Contribute to the technical vision and long-term roadmap of foundational AI systems.
Seniority
Lead, hands-on IC with strategic roadmap ownership