AI Engineer 4 (Gen AI Platform Services)
Core
Design, develop, test, deploy, and support large-scale Gen AI systems including foundation model training, LLM inference, agents, and multi-agent workflows for banking applications.
Role type
Senior IC AI Engineer (Gen AI Platform)
Builds
Scalable, high-performance AI infrastructure and proprietary Gen AI solutions for Capital One's customers and associates.
Domain
Financial Services / Generative AI / Large Scale Systems
Deliverable
production ML models
Required skills
Foundation model training, LLM inference, agent and multi-agent workflow design, similarity search, vector databases, model evaluation, system optimization, distributed systems design, GPU/TPU utilization, Python, Go, CUDA, Java
Preferred skills
Leading development of AI systems with cost/latency tradeoff decisions, deploying scalable AI on cloud platforms, building agentic AI systems, defining AI model governance processes, influencing architectural decisions across multiple product lines
Technologies
AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, CUDA, AWS, Google Cloud, Azure
Responsibilities
Partner with cross-functional teams to deliver AI-powered products, invent state-of-the-art optimization techniques for production AI systems, own end-to-end architecture for complex AI systems, define and maintain SLOs for AI reliability, collaborate with infrastructure engineering to optimize inference pipelines, lead technical reviews for security and compliance, mentor Principal and Senior Associates
Seniority
Senior, hands-on IC with mentorship responsibilities