AI Engineer 5 (Gen AI Platform Services - Agentic AI)
Core
Design, develop, and optimize large-scale production AI systems, including foundation model training, LLM inference, agentic workflows, and multi-model orchestration for banking applications.
Role type
Senior IC AI Engineer (Gen AI Platform & Agentic Systems)
Builds
Scalable, high-performance AI infrastructure and proprietary solutions empowering Capital One's products and internal teams.
Domain
Financial Services / Generative AI / Large Language Models
Deliverable
production ML models
Required skills
Foundation model training, LLM inference, agentic workflows, multi-model orchestration, vector search, model optimization, cost-performance governance, Python, Go, CUDA, Java
Preferred skills
Leading AI system development, cloud deployment (AWS/GCP/Azure), ethical AI standards, model compression, hardware right-sizing, heterogeneous AI system architecture
Technologies
AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, CUDA
Responsibilities
Design and implement multi-model orchestration pipelines integrating LLMs and vector search; lead cost-performance governance reviews tracking GPU utilization and inference costs; mentor Principal and Manager-level engineers; contribute to the technical vision and roadmap of foundational AI systems.
Seniority
Senior, hands-on IC with mentorship responsibilities