CareerPlanSign in

AI Engineer 5

San Jose, CA, US💼 Full-time💰 $229,900–$229,900🗓 2026-09-18 → 2026-09-26

Core

Design, develop, test, deploy, and support large-scale production AI systems, including foundation model training, LLM inference, multi-agent workflows, and optimization for cost, latency, and throughput.

Role type

Senior IC AI Engineer (Foundation Models & Infrastructure)

Builds

Scalable, high-performance AI infrastructure and proprietary solutions empowering Capital One's products

Domain

Banking / Applied AI & Machine Learning

Deliverable

production ML models

Required skills

Foundation model training, LLM inference, multi-agent workflow design, model optimization, system orchestration, cost-performance governance, technical leadership, mentorship

Preferred skills

Agentic AI systems, heterogeneous AI system architecture, ethical AI deployment standards, dynamic inference strategies, model compression, hardware right-sizing

Technologies

AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, CUDA, Python, Go, Scala, Java, C++, C#

Responsibilities

Design and implement multi-model orchestration pipelines integrating LLMs and vector search; Lead cost-performance governance reviews tracking GPU utilization and inference costs; Mentor Principal and Manager-level AI engineers; Contribute to the technical vision and long-term roadmap of foundational AI systems

Seniority

Senior, hands-on IC with mentorship responsibilities

Sourced via workday · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.