Senior Lead AI Engineer, Gen AI Services
Core
Design, develop, and maintain large-scale production AI systems including LLM inference and similarity search to transform banking operations and customer interactions.
Role type
Senior Lead AI Engineer (Gen AI Services)
Builds
Scalable AI infrastructure and software modules for Capital One's banking products
Domain
Financial Services / Generative AI / Cloud Infrastructure
Deliverable
production ML models
Required skills
Python, Go, Scala, Java, LLM Inference, Similarity Search, Model Training, Model Evaluation, Cloud Deployment, System Optimization, Team Leadership
Preferred skills
AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, C#, Golang, Hardware Support
Technologies
AWS, Azure, PyTorch, Huggingface, VectorDBs, AWS Ultraclusters
Responsibilities
Design and develop AI software modules including model training and inference; Optimize large-scale AI systems for scalability, cost, latency, and throughput; Contribute to long-term technical vision for foundational AI systems
Seniority
Senior, hands-on IC with leadership responsibilities