CareerPlanGet AI match score →

Senior Software Engineer - AI Engineering

San Francisco, CA, New York, NY, Portland, OR, or Remote within Canada or United States🌐 Remote💼 Full-time💰 $157,400–$206,650🗓 2026-06-09 → 2026-07-31

Core

Building and scaling Mercury's internal AI platform, MCP servers, and shared knowledge layer to enable company-wide AI adoption and agent capabilities.

Role type

Senior Software Engineer - AI Platform Infrastructure

Builds

MCP servers, LLM gateway infrastructure, shared prompt libraries, guardrails, policy-as-code, sandbox environments, and evaluation harnesses.

Domain

SaaS / Fintech / AI Infrastructure / LLM Systems

Deliverable

production ML models | infrastructure | product features

Required skills

Backend development in complex production systems, LLM-powered system architecture (RAG, agents, eval frameworks), platform engineering, infrastructure design, developer tooling, cost modeling, observability, latency optimization, safety engineering, self-directed execution, cross-functional communication

Preferred skills

Experience with MCP (Model Context Protocol), building self-service scaffolding for non-engineers, creating playgrounds for agent testing

Technologies

MCP servers, LLM gateways, RAG pipelines, agent frameworks, policy-as-code, sandbox environments

Responsibilities

Build and evolve MCP servers connecting internal systems; Expand and operate LLM gateway infrastructure (routing, rate limiting, cost attribution, observability); Turn early patterns into durable defaults (shared prompt libraries, guardrails, policy-as-code); Shape and maintain structured context artifacts for LLM reasoning; Improve internal knowledge discoverability and retrieval; Build sandbox environments and tooling for safe AI experimentation; Create self-service scaffolding for non-engineers to prototype AI workflows; Build playgrounds and evaluation harnesses for internal AI agents

Seniority

Senior, hands-on IC

Sourced via greenhouse · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.
Apply on Greenhouse ↗