AI Infrastructure Architect
Core
Architect and build custom AI infrastructure/hardware solutions, optimizing performance, power, cost, and scalability of computational stacks for large-scale AI/ML systems.
Role type
Senior IC AI Infrastructure Architect (Azure)
Builds
Scalable distributed training environments, model-serving foundations, automation patterns, and operational controls for enterprise AI adoption.
Domain
Cloud infrastructure + Artificial Intelligence
Deliverable
production ML models
Required skills
Azure AI/ML services, GPU/accelerated compute, distributed training, container platforms, model serving, high-throughput storage, secure cloud networking, Bicep/ARM/Terraform, CI/CD, Docker, Kubernetes, InfraOps, MLOps, observability, incident response
Preferred skills
LLM infrastructure, vector databases, retrieval pipelines, GPU scheduling, high-performance storage, low-latency model serving, enterprise architecture governance, FinOps, vendor collaboration
Technologies
Azure VMs, AKS, Azure Machine Learning, Azure Storage, Azure NetApp Files, Azure Virtual Network, Entra ID, Azure Monitor, Azure DevOps, GitHub Actions, Apache Airflow, Kubeflow
Responsibilities
Design and tune large-scale Azure GPU clusters and distributed training systems; develop and evaluate architecture alternatives; lead architecture assessments and reviews; drive architecture decision-making; define capacity planning models and scaling strategies; design deployment and CI/CD strategies; establish AI monitoring and observability practices; integrate AI/ML systems into enterprise environments; mentor engineers and review designs.
Seniority
Senior, hands-on IC with mentorship responsibilities
