Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
Core
Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, and observability for scalable, high-performance AI infrastructure.
Role type
Senior Lead AI Engineer (GenAI Platform, Agentic Infrastructure)
Builds
Proprietary AI platforms and systems that empower teams across Capital One to enhance products with transformative AI capabilities.
Domain
Banking / Generative AI / Large Language Models / Cloud Infrastructure
Deliverable
production ML models
Required skills
LLM inference, similarity search, vector databases, model guardrails, model evaluation, experimentation, system optimization, Python, Go, Scala, Java, PyTorch, AWS Ultraclusters, Huggingface, Nemo Guardrails
Preferred skills
Cloud platform deployment (AWS/GCP/Azure), leading and mentoring engineering teams, hardware utilization optimization, applying novel research techniques to production
Technologies
AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch
Responsibilities
Partner with cross-functional teams to deliver AI-powered products; Design and deploy AI software components; Invent LLM optimization techniques; Contribute to the technical vision and roadmap of foundational AI systems.
Seniority
Senior, hands-on IC with leadership responsibilities