AI Engineer: Benchmarking and Evaluation
Core
Design, develop, test, deploy, and support foundational AI systems including LLM inference, agentic workflows, similarity search, and model evaluation to improve scalability, cost, and latency.
Role type
Senior IC AI Engineer (Foundation Models & Evaluation)
Builds
Scalable AI infrastructure, foundation-model training pipelines, and production inference systems for banking customers.
Domain
Financial Services / Generative AI / Distributed Systems
Deliverable
production ML models
Required skills
Python, Go, Scala, CUDA, Java, LLM inference, vector databases, model evaluation, distributed systems, hardware optimization, agentic AI workflows, model governance
Preferred skills
Leading AI systems development, deploying scalable responsible AI on cloud platforms, designing distributed systems for petabyte-scale inference, defining AI model governance processes, influencing architectural decisions
Technologies
AWS, Azure, PyTorch, Hugging Face, vector databases, GPU/TPU
Responsibilities
Partner with cross-functional teams to deliver AI-powered products; design and optimize foundation-model training and inference pipelines; define service-level objectives for AI reliability; mentor senior associates on scalable design and performance tuning; lead technical reviews for security and compliance.
Seniority
Senior, hands-on IC
