CareerPlan

AI Engineer 4 (AI Foundations, LLM Core and Agentic AI)

San Jose, CA, USFull-time$197k2026-09-18 → 2026-11-10
Based in United StatesVisa sponsorship offered

Core

Design, develop, test, deploy, and support foundational AI systems including LLM inference, agentic workflows, and model optimization for banking applications.

Role type

Senior IC AI Engineer (LLM Core & Agentic AI)

Builds

Scalable, high-performance AI infrastructure and proprietary solutions for real-time customer experiences and internal associate tools.

Domain

Financial Services / Large Language Models / Distributed Systems

Deliverable

production ML models

Required skills

Foundation model training, LLM inference, agentic workflows, model optimization, distributed systems design, GPU/TPU utilization, service-level objectives (SLOs), technical roadmap planning, cross-functional leadership

Preferred skills

Leading AI system development with cost/latency tradeoffs, deploying scalable AI on cloud platforms, designing agentic AI systems, optimizing training/inference software, building petabyte-scale distributed systems, defining AI model governance processes

Technologies

AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, CUDA, Python, Go, Scala, Java, C++, C#

Responsibilities

Partner with cross-functional teams to deliver AI-powered products; Invent and introduce state-of-the-art foundation model optimization techniques; Own end-to-end architecture for complex AI systems; Define and maintain SLOs for AI reliability; Collaborate with infrastructure engineering to optimize GPU/TPU utilization; Lead cross-functional technical reviews for new AI system deployments; Mentor Principal and Senior Associates on scalable design and research-to-production translation

Seniority

Senior, hands-on IC with mentorship responsibilities