AI Infrastructure Architect
Core
Architect and build custom AI infrastructure/hardware solutions, optimizing performance, power, cost, and scalability of computational stacks for large-scale AI/ML systems.
Role type
Senior IC AI Infrastructure Architect (Azure)
Builds
Scalable distributed training environments, model-serving foundations, automation patterns, and operational controls for enterprise AI.
Domain
Cloud Infrastructure (Azure) + AI/ML
Deliverable
production ML models
Required skills
Azure AI/ML services, GPU/accelerated compute, distributed training, container platforms, model serving, high-throughput storage, secure cloud networking, Bicep/ARM/Terraform, CI/CD, Docker, Kubernetes, InfraOps, MLOps, observability, incident response, architecture decision records, FinOps
Preferred skills
LLM infrastructure, vector databases, retrieval pipelines, GPU scheduling, high-performance storage, low-latency model serving, enterprise architecture governance, vendor collaboration
Technologies
Microsoft Azure, Azure VMs, AKS, Azure Machine Learning, Azure Storage, Azure NetApp Files, Azure Virtual Network, Entra ID, Azure Monitor, Azure DevOps, GitHub Actions, Python, Java, C++, Bash, PowerShell, Apache Airflow, Kubeflow
Responsibilities
Design and tune large-scale Azure GPU clusters and distributed training systems; Serve as an authoritative AI infrastructure expert on Azure; Develop and evaluate architecture alternatives; Lead architecture assessments and reviews; Drive architecture decision-making; Define and maintain AI infrastructure roadmap inputs; Design deployment, automation, and CI/CD strategies; Establish AI monitoring and observability practices; Integrate AI/ML systems into enterprise environments; Collaborate with clients and stakeholders; Set technical direction and mentor engineers.
Seniority
Senior, hands-on IC with mentorship responsibilities
