CareerPlanGet AI match score →

Senior DevOps Engineer, AI Infrastructure

Toronto, Ontario, Canada💼 Full-time💰 $130,000–$145,000🗓 2026-07-09 → 2026-07-31

Core

Design, develop, and implement Generative AI (GenAI) solutions, including Agentic AI, LLMs, and RAG pipelines, to solve complex financial problems in risk assessment, fraud detection, and automated reporting.

Role type

Senior IC DevOps Engineer specializing in AI Infrastructure and GenAI application deployment

Builds

Production GenAI applications, AI Agents, and dynamic context retrieval systems for financial operations

Domain

Financial Services / Generative AI / LLM Infrastructure

Deliverable

production ML models

Required skills

GenAI model architecture, Agentic AI concepts, LLM fine-tuning and evaluation, prompt engineering, Python, Vector Databases (Qdrant, Pinecone, pgvector), RAG pipelines (LlamaIndex, LangGraph), MLOps, containerization (Docker/Kubernetes), CI/CD, cloud infrastructure (AWS/Azure/GCP)

Preferred skills

Financial data domain expertise, conversational AI design, data visualization tools, SQL databases

Technologies

AWS Bedrock, LangGraph, LlamaIndex, Qdrant, Pinecone, pgvector, Docker, Kubernetes, AWS, Azure, GCP

Responsibilities

Design and implement AI Agents with guardrails and tool orchestration; Architect and scale RAG and semantic search infrastructures; Develop and refine advanced prompting strategies; Test and evaluate LLM performance; Deploy and maintain GenAI models in production environments; Process and analyze large structured and unstructured datasets

Seniority

Senior, hands-on IC

Sourced via workable · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.
Apply on Workable ↗