CareerPlan

AI Infrastructure Architect

BengaluruFull-time2026-07-30 → 2026-11-16

Core

Architect and build custom AI infrastructure/hardware solutions, optimizing performance, power, cost, and scalability of computational stacks for large-scale AI/ML systems.

Role type

Senior IC AI Infrastructure Architect (Azure)

Builds

Scalable distributed training environments, model-serving foundations, automation patterns, and operational controls for enterprise AI.

Domain

Cloud Infrastructure (Azure) + AI/ML

Deliverable

production ML models

Required skills

Azure AI/ML services, GPU/accelerated compute, distributed training, container platforms, model serving, high-throughput storage, secure cloud networking, Bicep/ARM/Terraform, CI/CD, Docker, Kubernetes, InfraOps, MLOps, observability, incident response, architecture decision records, FinOps

Preferred skills

LLM infrastructure, vector databases, retrieval pipelines, GPU scheduling, high-performance storage, low-latency model serving, enterprise architecture governance, vendor collaboration

Technologies

Microsoft Azure, Azure VMs, AKS, Azure Machine Learning, Azure Storage, Azure NetApp Files, Azure Virtual Network, Entra ID, Azure Monitor, Azure DevOps, GitHub Actions, Python, Java, C++, Bash, PowerShell, Apache Airflow, Kubeflow

Responsibilities

Design and tune large-scale Azure GPU clusters and distributed training systems; Serve as an authoritative AI infrastructure expert on Azure; Develop and evaluate architecture alternatives; Lead architecture assessments and reviews; Drive architecture decision-making; Define and maintain AI infrastructure roadmap inputs; Design deployment, automation, and CI/CD strategies; Establish AI monitoring and observability practices; Integrate AI/ML systems into enterprise environments; Collaborate with clients and stakeholders; Set technical direction and mentor engineers.

Seniority

Senior, hands-on IC with mentorship responsibilities