CareerPlanSign in

Software Engineer II — Agentic AI Foundations

Hybrid - Toronto💼 Full-time🗓 2026-08-14 → 2026-09-26

Core

Design, build, and harden a secure, vendor-agnostic agent platform enabling the transition from traditional software workflows to agent-native operations.

Role type

Senior IC software engineer (agentic AI foundations)

Builds

A core platform for orchestration, tool use, memory, and runtime systems for agentic AI

Domain

Identity trust infrastructure / Agentic AI / LLM infrastructure

Deliverable

production ML models

Required skills

LLMs and agentic AI architectures, GPU computing and model serving, distributed systems, backend programming (Java/Go/Python), cloud-native infrastructure

Preferred skills

Multi-agent systems and workflow orchestration, agent platform development, evaluation frameworks, AI safety and policy systems, retrieval systems and knowledge graphs

Technologies

CUDA, vLLM, Ollama, LLMLite, TensorRT-LLM, Triton Inference Server

Responsibilities

Build components of a vendor-agnostic agent platform including orchestration and runtime systems; Implement evaluation and reliability tooling to measure agent performance; Help implement safety and governance controls; Build data grounding and memory components; Prototype and iterate on agent behaviors; Partner with product teams to implement agent-powered workflows

Seniority

Senior, hands-on IC

Sourced via ashby · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.