CareerPlanSign in

AI Engineer 4

New York, NY, US💼 Full-time💰 $197,300–$197,300🗓 2026-09-18 → 2026-09-26

Core

Design, develop, test, deploy, and support large-scale production AI systems including foundation model training, LLM inference, agents, and multi-agent workflows for banking applications.

Role type

Senior IC AI Engineer (Foundation Models & Infrastructure)

Builds

Scalable, high-performance AI infrastructure and proprietary solutions for real-time customer experiences and internal associate tools.

Domain

Financial Services / Large Language Models / Distributed Systems

Deliverable

production ML models

Required skills

Foundation model training, LLM inference, agent and multi-agent workflow design, similarity search, vector databases, model evaluation, system observability, GPU/TPU optimization, distributed systems architecture, Python, Go, CUDA, Java

Preferred skills

Leading development of AI systems with cost/latency tradeoff decisions, deploying scalable AI on cloud platforms, building agentic AI systems, designing distributed systems at petabyte scale, defining AI model governance processes

Technologies

AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, CUDA, AWS, Google Cloud, Azure

Responsibilities

Design and optimize end-to-end architecture for complex AI systems, define and maintain SLOs for AI reliability, collaborate with infrastructure engineering to optimize hardware utilization, lead cross-functional technical reviews for deployments, mentor Principal and Senior Associates on scalable design

Seniority

Senior, hands-on IC with mentorship responsibilities

Sourced via workday · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.