CareerPlanSign in

Senior Software Engineer - AI Systems

Onsite or remote • Boston+1💼 Full-time🗓 2026-06-24

Core

Senior engineer owning AI quality, reliability, and production LLM systems for an AI-native pediatric nurse triage platform.

Role type

Senior IC AI Systems Engineer (LLM/Healthcare)

Builds

Production AI workflows for patient intake, data extraction, and EHR documentation in pediatric care.

Domain

Healthcare (Pediatrics) + Generative AI / LLMs

Deliverable

production ML models

Required skills

Prompt engineering, LLM orchestration, evaluation framework design, backend systems (Python/Node.js), real-time streaming data, HIPAA compliance, system architecture

Preferred skills

Experience with Twilio, Anthropic, OpenAI, Livekit, PostgreSQL, Redis

Technologies

Python, Node.js, PostgreSQL, Redis, Twilio, Anthropic, OpenAI, Livekit

Responsibilities

Own prompt engineering across LLM workflows, build evaluation and testing frameworks for non-deterministic outputs, design guardrails and confidence thresholds for clinical safety, design and improve LLM orchestration for multi-step workflows, build infrastructure for prompt versioning and A/B testing, build and maintain core backend systems

Seniority

Senior, hands-on IC

Sourced via wellfound · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.