Lead AI Engineer ( MLX, Gen AI Platform Services, Agentic AI)
Core
Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, similarity search, guardrails, and observability to build scalable, high-performance AI infrastructure for banking.
Role type
Lead AI Engineer (MLX, Gen AI Platform Services, Agentic AI)
Builds
Proprietary AI platforms and services that empower teams across Capital One to enhance products with transformative AI capabilities.
Domain
Banking / Generative AI / Large Language Models / MLOps
Deliverable
production ML models
Required skills
Python, Go, Scala, Java, C++, C#, LLM Inference, Similarity Search, VectorDBs, Guardrails, Memory, LLM optimization, hardware utilization, latency optimization, throughput optimization, cost optimization, model evaluation, experimentation, governance, observability
Preferred skills
Cloud platform deployment (AWS, Google Cloud, Azure), scalable AI solution design, state-of-the-art AI research application
Technologies
AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch
Responsibilities
Partner with cross-functional teams to deliver AI-powered products; Design and implement AI software components; Invent and introduce state-of-the-art LLM optimization techniques; Contribute to the technical vision and long-term roadmap of foundational AI systems.
Seniority
Lead, hands-on IC with strategic roadmap contribution