Lead AI Engineer (Vision model customization, VLM)
Core
Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability to deliver AI-powered products.
Role type
Lead AI Engineer (LLM optimization & inference)
Builds
Proprietary AI solutions and platforms for Capital One's banking products
Domain
Financial Services / Large Language Models / AI Infrastructure
Deliverable
production ML models
Required skills
Python, Go, Scala, Java, LLM inference, similarity search, vector databases, model optimization, system design, cloud platforms
Preferred skills
AWS, Google Cloud, Azure, C++, C#, Golang, hardware utilization optimization, state-of-the-art AI research application
Technologies
AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch
Responsibilities
Partner with cross-functional teams to deliver AI-powered products; Design and deploy AI software components; Invent LLM optimization techniques; Contribute to technical vision and roadmap of foundational AI systems
Seniority
Lead, hands-on IC with strategic input