Lead AI Engineer (Vision Models, VLM)
Core
Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, and guardrails to improve banking products.
Role type
Lead AI Engineer (Vision Models, VLM)
Builds
Proprietary AI solutions serving millions of Capital One customers
Domain
Banking + Large Language Models & Vision
Deliverable
production ML models
Required skills
Python, Go, Scala, Java, C++, C#, LLM inference, similarity search, vector databases, model evaluation, experimentation, governance, observability, hardware optimization
Preferred skills
deploying scalable AI on cloud platforms, designing AI services, optimizing training/inference for hardware utilization and latency, applying modern AI research methods
Technologies
AWS, Azure, PyTorch, Hugging Face, NeMo Guardrails, VectorDBs, AWS Ultraclusters
Responsibilities
Partner with cross-functional teams to deliver AI-powered products; design and implement advanced LLM optimization approaches; help shape the technical vision and long-term roadmap for foundational AI systems
Seniority
Senior, hands-on IC with strategic input