Principal Software Engineer
Core
Senior technical lead owning the architecture for Enterprise AI, including AI gateways, control planes, model serving, and observability for hosted and installed editions.
Role type
Principal Software Engineer (AI Infrastructure)
Builds
AI gateway, control plane, model serving, identity, metering, and observability systems for Kubernetes-based AI infrastructure.
Domain
Cloud Infrastructure / AI / Machine Learning
Deliverable
production ML models
Required skills
Kubernetes architecture, Go, Python, distributed systems, GPU workload management, LLM inference, infrastructure as code, CI/CD, Helm, CRDs, policy-based routing, technical leadership, AI-assisted development.
Preferred skills
Inference performance optimization (quantization, batching, KV-cache), AI gateway routing strategies, enterprise product launch experience.
Responsibilities
Own architecture across AI gateway, control plane, model serving, identity, metering, and observability; lead gateway strategy including data plane choice and policy-based routing; set direction for LLM serving on Kubernetes including GPU scheduling and autoscaling; define enterprise deployment methods including Helm installs and air-gapped networks; run design reviews and make build vs. buy decisions; build hands-on in critical path and mentor senior engineers; represent the company in Kubernetes and ML-infrastructure communities.
Seniority
Principal, hands-on IC with mentorship