CareerPlanSign in

AI Engineer 4 (AI Foundations, LLM Core and Agentic AI)

San Jose, CA, US💼 Full-time💰 $197,300–$197,300🗓 2026-09-18 → 2026-09-25

Core

Design, develop, test, deploy, and support foundational AI systems including LLM inference, agentic workflows, and model optimization for banking applications.

Role type

Senior IC AI Engineer (LLM Core & Agentic AI)

Builds

Scalable, high-performance AI infrastructure and proprietary solutions for real-time customer experiences and internal associate tools.

Domain

Financial Services / Large Language Models / Distributed Systems

Deliverable

production ML models

Required skills

Foundation model training, LLM inference, agentic workflows, model optimization, distributed systems design, GPU/TPU utilization, service-level objectives (SLOs), technical roadmap planning, cross-functional leadership

Preferred skills

Leading AI system development with cost/latency tradeoffs, deploying scalable AI on cloud platforms, designing agentic AI systems, optimizing training/inference software, building petabyte-scale distributed systems, defining AI model governance processes

Technologies

AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, CUDA, Python, Go, Scala, Java, C++, C#

Responsibilities

Partner with cross-functional teams to deliver AI-powered products; Invent and introduce state-of-the-art foundation model optimization techniques; Own end-to-end architecture for complex AI systems; Define and maintain SLOs for AI reliability; Collaborate with infrastructure engineering to optimize GPU/TPU utilization; Lead cross-functional technical reviews for new AI system deployments; Mentor Principal and Senior Associates on scalable design and research-to-production translation

Seniority

Senior, hands-on IC with mentorship responsibilities

Sourced via workday · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.