Senior Lead AI Engineer (LLM Gateway)
Core
Architecting, building, and optimizing large-scale LLM inference, similarity search, and guardrails systems to improve banking products.
Role type
Senior Lead AI Engineer (LLM Gateway)
Builds
Production AI software components for foundation model training, inference, and observability.
Domain
Financial services / Large Language Models / Cloud Infrastructure
Deliverable
production ML models
Required skills
Python, Go, Scala, Java, C++, C#, LLM inference, similarity search, vector databases, model optimization, cloud deployment, team leadership, technical roadmap planning
Preferred skills
Advanced optimization methods, hardware utilization, latency reduction, cost reduction, translating research to production
Technologies
AWS, Azure, PyTorch, Hugging Face, NeMo Guardrails, vector databases, AWS Ultraclusters
Responsibilities
Partner with engineers and product managers to deliver AI-powered products; Design, build, test, deploy, and support AI software components; Create and apply LLM optimization approaches; Shape technical direction and long-term roadmap for foundational AI platforms.
Seniority
Senior Lead, hands-on IC with mentorship