AI Engineer 5 (Gen AI Platform Services)
Core
Design, develop, test, deploy, and support large-scale Gen AI systems, including foundation model training, LLM inference, multi-agent workflows, and optimization for banking applications.
Role type
Senior IC Gen AI Platform Engineer
Builds
Scalable, high-performance AI infrastructure and proprietary Gen AI solutions for Capital One's banking products.
Domain
Financial Services / Generative AI / Large Language Models
Deliverable
production ML models
Required skills
Foundation model training, LLM inference, multi-agent workflow design, model optimization, vector search, similarity search, system architecture, Python, Go, CUDA, Java, PyTorch, AWS Ultraclusters, Huggingface, VectorDBs
Preferred skills
Agentic AI systems design, heterogeneous AI system integration, ethical AI deployment standards, dynamic inference strategies, model compression, hardware right-sizing
Technologies
AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, CUDA, Python, Go, Scala, Java, C++, C#
Responsibilities
Design and implement multi-model orchestration pipelines integrating LLMs and vector search; Lead cost-performance governance reviews tracking GPU utilization and inference costs; Mentor Principal and Manager-level AI engineers; Contribute to the technical vision and long-term roadmap of foundational AI systems.
Seniority
Senior, hands-on IC with mentorship responsibilities

