CareerPlan

Senior Software Engineer, AI Infrastructure Solutions

India, PuneFull-time2026-11-05 → 2026-11-10

Core

Design, build, and operate AI infrastructure solutions powering LLM-based applications and autonomous agents across the enterprise.

Role type

Senior Software Engineer (AI Infrastructure)

Builds

Agentic AI workflows, multi-agent systems, LLM inference endpoints, and scalable containerized AI platforms.

Domain

Artificial Intelligence / Large Language Models / Cloud Infrastructure

Deliverable

production ML models

Required skills

Python, LLM integration, agentic AI workflows, multi-agent orchestration, RAG, Docker, Kubernetes, CI/CD pipelines, RESTful API development, observability, root-cause analysis, performance tuning

Preferred skills

C#/.NET Core, GPU-accelerated workloads, NVIDIA AI Enterprise, Triton Inference Server, NeMo, MCP (Model Context Protocol), LLM evaluation frameworks

Technologies

LangChain, LangGraph, Docker, Kubernetes, Helm, GitHub Actions, Azure DevOps, GitLab CI, Jenkins, NVIDIA NIM, OpenAI-compatible APIs, Hugging Face

Responsibilities

Design and build AI infrastructure for LLM applications; develop agentic AI workflows and multi-agent systems; integrate and serve LLMs via APIs; containerize and deploy applications on Kubernetes; own production readiness and L3 support; define observability for AI systems; build CI/CD pipelines; develop high-performance backend services

Seniority

Senior, hands-on IC