AI Engineer 4 (MLX, Agentic AI, Gen AI platform Services)
Core
Design, develop, test, deploy, and support large-scale production AI systems including foundation model training, LLM inference, agentic workflows, and multi-agent systems for banking applications.
Role type
Senior IC AI Engineer (MLX, Agentic AI, Gen AI platform)
Builds
Scalable, high-performance AI infrastructure and proprietary AI services empowering Capital One products
Domain
Financial Services / Generative AI / Large Language Models / Distributed Systems
Deliverable
production ML models
Required skills
Foundation model optimization, LLM inference, agentic AI system design, multi-agent workflows, similarity search, vector databases, model evaluation, SLO definition, GPU/TPU optimization, distributed systems design, Python, Go, CUDA, Java
Preferred skills
Leading AI system development with cost/latency tradeoff decisions, deploying scalable AI on cloud platforms, designing distributed systems for petabyte-scale inference, AI model governance processes, influencing architectural decisions across product lines
Technologies
AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, CUDA, Golang
Responsibilities
Partner with cross-functional teams to deliver AI-powered products; Invent and introduce state-of-the-art foundation model optimization techniques; Own end-to-end architecture for complex AI systems ensuring maintainability and ethical alignment; Define and maintain SLOs for AI reliability; Collaborate with infrastructure engineering to optimize GPU/TPU utilization; Lead cross-functional technical reviews for new AI system deployments; Mentor Principal and Senior Associates on scalable design and research-to-production translation
Seniority
Senior, hands-on IC with mentorship responsibilities