AI Engineer 4 (AI Foundations, LLM Core and Agentic AI)
Core
Design, develop, and deploy scalable foundation models, LLM inference, and agentic AI workflows to power real-time banking experiences and internal tools.
Role type
Senior IC AI Engineer (LLM Core & Agentic Systems)
Builds
Production AI systems including foundation model training, multi-agent workflows, similarity search, and guardrails for Capital One's banking platform.
Domain
Financial Services / Large Language Models / Distributed Systems
Deliverable
production ML models
Required skills
Python, Go, CUDA, Java, LLM inference, foundation model optimization, multi-agent system design, distributed systems architecture, GPU/TPU utilization, model governance, SLO definition
Preferred skills
Leading AI system development with cost/latency tradeoffs, deploying scalable AI on cloud platforms, building agentic AI workflows, optimizing training/inference software, designing petabyte-scale distributed systems
Technologies
AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, CUDA, Golang
Responsibilities
Design and deploy AI software components (training, inference, agents); optimize foundation model performance for scalability and cost; define SLOs for AI reliability; collaborate on infrastructure to accelerate inference pipelines; mentor senior associates on scalable design and research-to-production translation.
Seniority
Senior, hands-on IC with mentorship responsibilities
