Senior Lead AI Engineer (GenAI Platform Services)
Core
Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability to deliver AI-powered products for banking customers and associates.
Role type
Senior Lead AI Engineer (GenAI Platform Services)
Builds
Proprietary AI platforms and scalable, high-performance AI infrastructure for Capital One's banking products.
Domain
Financial Services / Generative AI / Large Language Models
Deliverable
production ML models
Required skills
Python, Go, Scala, Java, C++, C#, LLM Inference, Similarity Search, VectorDBs, Guardrails, Memory, LLM optimization, hardware utilization optimization, latency optimization, throughput optimization, cost optimization, model evaluation, experimentation, governance, observability, foundation model training
Preferred skills
Cloud platform deployment (AWS, Google Cloud, Azure), leading and mentoring engineering teams, cross-functional stakeholder influence, applying novel research techniques in production
Technologies
AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch
Responsibilities
Partner with cross-functional teams to deliver AI-powered products; Design, develop, test, deploy, and support AI software components; Invent and introduce state-of-the-art LLM optimization techniques; Contribute to the technical vision and long term roadmap of foundational AI systems.
Seniority
Senior Lead, hands-on IC with mentorship responsibilities