AI Engineer 5 (FM Hosting, LLM Inference)
Core
Design, develop, test, deploy, and support large-scale AI systems including foundation model training, LLM inference, agents, and multi-agent workflows for banking applications.
Role type
Senior IC AI Engineer (LLM Inference & System Optimization)
Builds
Scalable, high-performance AI infrastructure and production AI systems (LLMs, vector search, guardrails) for Capital One's customer-facing and internal banking products.
Domain
Financial Services / Large Language Models / Distributed Systems
Deliverable
production ML models
Required skills
Python, Go, Scala, CUDA, Java, LLM Inference, Foundation Model Optimization, Multi-agent Workflows, VectorDBs, System Architecture, Cost-Performance Governance, Model Orchestration
Preferred skills
Leading AI system development, Cloud platform deployment (AWS/GCP/Azure), Agentic AI systems, Ethical AI deployment, Dynamic inference strategies, Model compression, Heterogeneous AI system integration
Technologies
AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, CUDA
Responsibilities
Design and optimize multi-model orchestration pipelines; Establish cost-performance governance reviews; Lead team design councils; Mentor Principal and Manager-level engineers; Invent state-of-the-art optimization techniques for production AI systems.
Seniority
Senior, hands-on IC with mentorship responsibilities
