AI Architect
Core
Senior technical voice and architect for customers building or operating AI infrastructure, including GPU clusters, inference platforms, and AI gateways.
Role type
Senior IC AI Architect (Infrastructure & Platform)
Builds
Reference architectures, phased roadmaps, and clear designs for production AI platforms.
Domain
AI Infrastructure, High-Performance Computing (HPC), Cloud Platforms
Deliverable
production ML models
Required skills
LLM inference deployment, GPU infrastructure management, Kubernetes, AI gateway design, multi-tenant cloud design, AI usage governance, build/buy/compose strategy
Preferred skills
Multi-tenant GPU cloud design, batch schedulers (Slurm), RAG/agentic systems, regulated deployment experience, observability for AI services
Technologies
vLLM, TensorRT-LLM, llm-d, Triton, Kubernetes, NVIDIA/AMD accelerators, AWS/GCP/Azure, LiteLLM, Traefik, Envoy, Tetrate
Responsibilities
Lead technical discovery and translate business goals into AI platform architectures; Design inference serving platforms on Kubernetes and bare metal; Design AI gateway and routing layers; Define reference architectures for multi-tenant GPU clouds and hybrid estates; Advise on AI usage governance and security posture; Evaluate and recommend build, buy, or compose decisions; Review implementations and own technical quality; Represent the company in customer architecture reviews and executive readouts.
Seniority
Senior, hands-on IC
