CareerPlanSign in

Principal Software Engineer, Core AI Platform

USA💼 Full-time💰 $61,000–$61,000🗓 2026-09-05 → 2026-10-03

Core

Architect and design solutions to improve the reliability and scalability of AI/ML platforms and applications, building reusable platform services, APIs, SDKs, and agents to standardize model hosting and inference.

Role type

Principal Software Engineer (AI Infrastructure Platform)

Builds

Reusable platform services, APIs, SDKs, agents, skills, and libraries for model hosting and inference.

Domain

Financial services, Cloud infrastructure, Artificial Intelligence, Machine Learning

Required skills

Python, System design, Automated testing, Observability, Incident response, Root-cause analysis, Cloud platforms, Distributed systems, Infrastructure engineering, Technical leadership

Preferred skills

AI infrastructure management on cloud, Creating reusable golden-path assets (templates, SDKs, guides), Developing generative AI applications or AI agents

Technologies

Python, Cloud platforms, AI Agents, Machine Learning, Security

Responsibilities

Architect and design solutions for AI/ML platform reliability and scalability; Build and refine reusable platform services, APIs, SDKs, and agents; Partner with infrastructure teams to deliver AI Foundation Services; Own non-functional requirements and develop tooling for observability, resilience, and cost optimization; Establish standards and reference architectures for operational readiness; Participate in on-call rotations and resolve complex production incidents; Mentor engineers and raise engineering quality standards.

Sourced via devitjobs · Listed on CareerPlan, which tracks 940,000+ jobs from 20+ sources.