CareerPlan

Principal Software Engineer

Austin, TX, usRemoteFull-time2026-10-30 → 2026-11-19

Core

Senior technical lead owning the architecture for Enterprise AI, including AI gateways, control planes, model serving, and observability for hosted and installed editions.

Role type

Principal Software Engineer (AI Infrastructure)

Builds

AI gateway, control plane, model serving, identity, metering, and observability systems for Kubernetes-based AI infrastructure.

Domain

Cloud Infrastructure / AI / Machine Learning

Deliverable

production ML models

Required skills

Kubernetes architecture, Go, Python, distributed systems, GPU workload management, LLM inference, infrastructure as code, CI/CD, Helm, CRDs, policy-based routing, technical leadership, AI-assisted development.

Preferred skills

Inference performance optimization (quantization, batching, KV-cache), AI gateway routing strategies, enterprise product launch experience.

Responsibilities

Own architecture across AI gateway, control plane, model serving, identity, metering, and observability; lead gateway strategy including data plane choice and policy-based routing; set direction for LLM serving on Kubernetes including GPU scheduling and autoscaling; define enterprise deployment methods including Helm installs and air-gapped networks; run design reviews and make build vs. buy decisions; build hands-on in critical path and mentor senior engineers; represent the company in Kubernetes and ML-infrastructure communities.

Seniority

Principal, hands-on IC with mentorship