Sr. Lead AI Engineer (GenAI Platform)
Core
Design, develop, test, deploy, and support foundational AI systems including foundation model training, LLM inference, similarity search, and guardrails to empower Capital One's products and internal teams.
Role type
Sr. Lead AI Engineer (GenAI Platform)
Builds
Proprietary AI platforms and scalable, high-performance AI infrastructure for banking applications.
Domain
Financial Services / Generative AI / Large Language Models
Deliverable
production ML models
Required skills
Python, Go, Scala, Java, C++, C#, LLM optimization, model evaluation, experimentation, governance, observability, PyTorch, vector databases, Nemo Guardrails, AWS Ultraclusters, Huggingface
Preferred skills
Leading and mentoring engineering teams, deploying scalable AI on cloud platforms, optimizing training and inference software for hardware utilization and latency, applying novel research techniques in production
Technologies
AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch
Responsibilities
Partner with cross-functional teams to deliver AI-powered products; Design and implement AI software components; Invent LLM optimization techniques; Contribute to the technical vision and roadmap of foundational AI systems.
Seniority
Senior, hands-on IC with leadership responsibilities