AI Engineer 5 (SDK's: Gen AI Evaluation and MCP)
Core
Design, develop, test, deploy, and support AI software components including foundation model training, LLM inference, agents, multi-agent workflows, similarity search, guardrails, model evaluation, and observability for banking applications.
Role type
Senior IC AI Engineer (Gen AI Systems & Optimization)
Builds
Scalable, high-performance AI infrastructure and proprietary solutions empowering teams across Capital One to enhance products with AI.
Domain
Banking / Generative AI / Large Language Models / System Optimization
Deliverable
production ML models
Required skills
Foundation model training, LLM inference, multi-agent workflows, similarity search, model evaluation, system optimization, cost-performance governance, multi-model orchestration, Python, Go, CUDA, Java
Preferred skills
Leading development of AI systems with tradeoff decisions, deploying scalable AI on cloud platforms, building agentic AI systems, architecting heterogeneous AI systems, enforcing ethical AI standards, dynamic inference strategies, model compression, right-sizing models
Technologies
AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, CUDA
Responsibilities
Partner with cross-functional teams to deliver AI-powered products; Design and optimize multi-model orchestration pipelines; Establish and lead cost-performance governance reviews; Lead team design councils to ensure technical consistency; Mentor Principal and Manager-level AI engineers.
Seniority
Senior, hands-on IC with mentorship responsibilities