Lead AI Engineer (AI Foundations)
Core
Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability to build scalable, high-performance AI infrastructure.
Role type
Lead AI Engineer (AI Foundations)
Builds
Proprietary AI models and platforms that empower teams across Capital One to enhance products with transformative AI capabilities.
Domain
Banking / Applied AI & Machine Learning
Deliverable
production ML models
Required skills
Foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, observability, LLM optimization, Python, Go, Scala, Java
Preferred skills
Deploying scalable AI solutions on cloud platforms, designing and supporting AI services, optimizing training and inference software for hardware utilization and latency, applying novel AI research techniques in production
Technologies
AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch
Responsibilities
Partner with cross-functional teams to deliver AI-powered products; Design and implement AI software components; Invent and introduce state-of-the-art LLM optimization techniques; Contribute to the technical vision and long-term roadmap of foundational AI systems.
Seniority
Lead, hands-on IC with strategic roadmap contribution