CareerPlan

Senior Software Engineer, AI Infrastructure Solutions

India, PuneFull-time2026-11-05 → 2026-11-10

Core

Design, build, and operate AI infrastructure solutions powering LLM-based applications and autonomous agents across the enterprise.

Role type

Senior Software Engineer (AI Infrastructure)

Builds

Agentic AI workflows, multi-agent systems, LLM integration endpoints, and scalable containerized AI platforms.

Domain

Artificial Intelligence / Large Language Models / Cloud Infrastructure

Deliverable

production ML models

Required skills

Python, C#/.NET Core, Docker, Kubernetes, LLM integration, API development, CI/CD pipelines, observability, root-cause analysis, multi-agent orchestration, RAG

Preferred skills

GPU-accelerated workloads, NVIDIA AI Enterprise, Triton Inference Server, NeMo, Model Context Protocol (MCP), LLM evaluation frameworks

Technologies

LangChain, LangGraph, OpenAI-compatible APIs, NVIDIA NIM, Hugging Face, GitHub Actions, Azure DevOps, GitLab CI, Jenkins, RESTful APIs

Responsibilities

Design and build AI infrastructure for LLM applications; develop agentic AI workflows and multi-agent systems; integrate and serve LLMs via APIs; containerize and deploy on Kubernetes; own production readiness and L3 support; define observability for AI systems; build CI/CD pipelines; develop high-performance backend services.

Seniority

Senior, hands-on IC