AI Engineer 4 (AI Foundations, LLM Core and Agentic AI)
Core
Design, develop, test, deploy, and support foundational AI systems including LLM inference, agentic workflows, and optimization for scalable production environments.
Role type
Senior IC AI Engineer (LLM Core & Agentic AI)
Builds
Proprietary AI platforms and services empowering Capital One's products with real-time, personalized customer experiences.
Domain
Financial Services / Large Language Models / Distributed Systems
Deliverable
production ML models
Required skills
Python, Go, Scala, CUDA, Java, LLM Inference, VectorDBs, Guardrails, Model Optimization, Distributed Systems, GPU/TPU Utilization
Preferred skills
Leading AI system development, Cloud platform deployment (AWS/GCP/Azure), Agentic AI workflows, Petabyte-scale distributed systems, AI model governance
Technologies
AWS Ultraclusters, Huggingface, PyTorch, VectorDBs, CUDA
Responsibilities
Design and optimize foundation model training and inference pipelines; Invent state-of-the-art optimization techniques for scalability and cost; Own end-to-end architecture for complex AI systems; Define and maintain SLOs for AI reliability; Collaborate with infrastructure to accelerate model inference; Mentor Principal and Senior Associates on scalable design.
Seniority
Senior, hands-on IC
