IN-Manager _AI Architect __ GCC_ Advisory_ Bangalore
Core
Design and manage AI/ML pipelines, LLM serving architectures, and optimization strategies for large language models to support client business decisions.
Role type
Senior IC AI Architect (LLM & MLOps)
Builds
Scalable ML pipelines, model inference APIs, and optimized LLM serving infrastructure for enterprise clients.
Domain
Data, Analytics & AI (Generative AI, Large Language Models)
Deliverable
production ML models
Required skills
LLM architecture, GPU architecture, distributed training, model fine-tuning, DevOps/LLMOps, Kubernetes, Docker, Python, PyTorch/TensorFlow, LangChain, LangGraph, MLflow, SageMaker, Vertex AI, Azure AI
Preferred skills
SQL, machine learning, data science
Technologies
Hugging Face, GPT, Gemini, Claude, Mixtral, Llama, DeepSpeed, vLLM, Flowise, Langflow, Langgraph, DynamoDB, Cosmos, MongoDB, RDS, MySQL, PostgreSQL, Aurora, Spanner, Google BigQuery, AWS, Azure, GCP, FluentD, Kibana, Grafana, Prometheus
Responsibilities
Design ML pipelines for experiment, model, and feature management; design APIs for model inferencing at scale; implement distributed training and serving for LLMs; optimize model fine-tuning for latency and accuracy; manage DevOps and LLMOps practices.
Seniority
Manager, hands-on IC
