AI Engineer 5 (FM Hosting, LLM Inference)
Core
Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, agents, and multi-agent workflows for banking applications.
Role type
Senior IC AI Engineer (LLM Inference & Foundation Models)
Builds
Scalable, high-performance AI infrastructure and proprietary solutions for Capital One's banking products.
Domain
Financial Services / Large Language Models / AI Infrastructure
Deliverable
production ML models
Required skills
Python, Go, CUDA, Java, PyTorch, VectorDBs, LLM Inference, Model Optimization, Multi-model Orchestration, GPU Utilization, Cost-performance Governance
Preferred skills
Leading AI system development, Cloud platform deployment (AWS/GCP/Azure), Agentic AI systems, Ethical AI deployment, Model compression, Heterogeneous AI system integration
Technologies
AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, CUDA
Responsibilities
Design and implement multi-model orchestration pipelines integrating LLMs and vector search; Establish cost-performance governance reviews tracking GPU utilization and inference cost; Lead team design councils to ensure technical consistency; Mentor Principal and Manager-level AI engineers.
Seniority
Senior, hands-on IC with mentorship responsibilities