Lead AI Engineer, AI Foundations
Core
Design, implement, and optimize large-scale production AI systems, including foundation model training and LLM inference, to transform banking workflows and customer interactions.
Role type
Senior IC AI Engineer (AI Foundations)
Builds
Scalable AI services, foundation models, and LLM inference pipelines for Capital One's banking platform.
Domain
Financial services / Large Language Models / Cloud Infrastructure
Deliverable
production ML models
Required skills
Python, Go, Scala, Java, C++, C#, AWS, Google Cloud, Azure, PyTorch, VectorDBs, Nemo Guardrails, Huggingface, Helm, model evaluation, experimentation, governance, observability, LLM optimization, hardware efficiency, latency reduction, throughput enhancement, cost management
Preferred skills
Designing and delivering AI services, implementing scalable and responsible AI solutions on cloud platforms, enhancing training and inference software
Technologies
AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, AWS, Azure, C#, Golang, Java, LLM, Machine Learning, Python, Scala
Responsibilities
Collaborate with engineers, scientists, and product managers to develop AI-driven products; Design, implement, test, launch, and maintain AI software components including foundation model training and LLM inference; Innovate and deploy cutting-edge LLM optimization methods; Contribute to the technical vision and long-term strategy for foundational AI systems.