CareerPlan

Principal Software Engineer - AI Platform

Salt Lake City, UT, USFull-time$180k–$280k2026-10-29 → 2026-11-10
On-site

Core

Architect and build a conversational AI platform for student, staff, and application experiences, focusing on retrieval, inference, orchestration, guardrails, and security.

Role type

Principal Software Engineer (AI Platform)

Builds

Scalable, secure, and observable AI solutions and platform capabilities for engineering teams

Domain

Higher Education Technology / Generative AI

Deliverable

production ML models

Required skills

Architecture design, LLM application development (RAG, tool calling), API design, Security & privacy (FERPA), Observability, Java, AWS

Preferred skills

MCP servers, Agent orchestration, AI safety testing, Multi-tenant data isolation, Infrastructure as code

Technologies

Java, Angular, AWS, MCP, RAG

Responsibilities

Architect and build conversational AI platform with retrieval and orchestration; Own security and privacy model aligned with FERPA; Build guardrails and governance capabilities; Establish evaluation and observability frameworks; Define MCP servers, tool contracts, and APIs; Design, build, test, and operate production services on AWS; Provide technical leadership and mentorship

Seniority

Principal, hands-on IC with strategy & mentorship