CareerPlanGet AI match score →

Senior AI Platform Engineer

Boston💼 Full-time💰 $200,000–$200,000🗓 2026-05-06 → 2026-07-31

Core

Design and operate the shared AI platform enabling inference services, agentic platforms, and developer tooling for a financial services firm.

Role type

Senior AI Platform Engineer

Builds

Managed LLM inference services, MCP registries/gateways, authorization services, and AI productivity dashboards

Domain

Financial services / AI Infrastructure

Deliverable

production ML models | infrastructure

Required skills

AWS Bedrock, Azure OpenAI, MCP (Model Context Protocol) architecture, LLM production workloads, AI security controls, agentic AI patterns (RAG, function calling), platform engineering

Preferred skills

Financial services experience, Microsoft M365 Copilot, observability pipelines (Splunk, ELK, Datadog, Grafana), Kubernetes, model fine-tuning

Technologies

Amazon Bedrock, Azure OpenAI, Linux VDI, M365/Excel, VPC, PrivateLink, Kubernetes

Responsibilities

Design and operate core AI platform infrastructure including inference services and model access management; Build self-service onboarding and cost management systems; Partner with security to embed controls preventing destructive agent actions; Define reference architectures for agentic AI patterns

Seniority

Senior, hands-on IC

Sourced via workday · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.
Apply on Workday ↗