Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
Core
Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, and observability for banking applications.
Role type
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
Builds
Proprietary AI solutions and scalable, high-performance AI infrastructure for Capital One's banking products.
Domain
Financial Services / Generative AI / Large Language Models
Deliverable
production ML models
Required skills
Foundation model training, LLM inference, similarity search, guardrails, model evaluation, experimentation, governance, observability, LLM optimization, Python, Go, Scala, Java, AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch
Preferred skills
Deploying scalable AI solutions on cloud platforms, leading and mentoring engineering teams, optimizing training and inference software for hardware utilization and latency, applying novel AI research techniques in production
Technologies
AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch
Responsibilities
Partner with cross-functional teams to deliver AI-powered products, design and deploy AI software components, invent LLM optimization techniques, contribute to the technical vision of foundational AI systems
Seniority
Senior Lead, hands-on IC with mentorship responsibilities