Senior Lead AI Engineer (SDK's: Gen AI Evaluation and MCP)
Core
Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, model evaluation, and observability to build scalable, high-performance AI infrastructure for banking.
Role type
Senior Lead AI Engineer (Gen AI Evaluation and MCP)
Builds
Proprietary AI platforms and SDKs that empower teams across Capital One to enhance products with transformative AI capabilities.
Domain
Financial Services / Generative AI / Large Language Models
Deliverable
production ML models
Required skills
LLM inference, similarity search, vector databases, model evaluation, guardrails, system optimization, Python, Go, Scala, Java, PyTorch, AWS Ultraclusters, Huggingface, Nemo Guardrails
Preferred skills
Cloud platform deployment (AWS/GCP/Azure), leading and mentoring engineering teams, optimizing training and inference software for hardware utilization and latency, applying novel research techniques in production
Technologies
AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, Python, Go, Scala, Java, C++, C#
Responsibilities
Partner with cross-functional teams to deliver AI-powered products; Design and deploy AI components including foundation model training and LLM inference; Invent state-of-the-art LLM optimization techniques; Contribute to the technical vision and long-term roadmap of foundational AI systems.
Seniority
Senior, hands-on IC with leadership responsibilities