Senior Lead AI Engineer, GenAI Platform
Core
Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, and guardrails to improve how associates work and customers engage with Capital One.
Role type
Senior Lead AI Engineer, GenAI Platform
Builds
Proprietary AI systems serving millions of customers across Capital One's banking products
Domain
Financial Services / Generative AI / Large Language Models
Deliverable
production ML models
Required skills
LLM inference, similarity search, vector databases, guardrails, model evaluation, experimentation, governance, observability, LLM optimization, scalable AI system design, cloud platform deployment, team leadership, technical roadmap planning
Preferred skills
Advanced training and inference software optimization, hardware utilization tuning, latency and throughput optimization, cost reduction in AI systems, applying new AI research techniques in production
Technologies
AWS, Azure, PyTorch, Hugging Face, NeMo Guardrails, vector databases, AWS Ultraclusters, C#, Golang, Java, Python, Scala
Responsibilities
Partner with engineers, research scientists, and product managers to deliver AI-powered products; design and build AI components spanning training, inference, and governance; invent and apply advanced LLM optimization approaches; shape the technical direction and long-term roadmap for foundational AI systems
Seniority
Senior, hands-on IC with leadership responsibilities