CareerPlanGet AI match score →

Senior Software Engineer, Agent Infrastructure

Toronto🌐 Remote💼 Full-time🗓 2026-03-12 → 2026-07-31

Core

Building the next generation of agentic AI infrastructure, creating the platform that powers autonomous AI agents at scale.

Role type

Senior Software Engineer, Agent Infrastructure

Builds

Platform for autonomous AI agents, including secure execution environments, identity systems, and model routing.

Domain

Artificial Intelligence / Distributed Systems / Cloud Infrastructure

Deliverable

production ML models | infrastructure

Required skills

building production ML infrastructure, systems fundamentals, agentic systems, multi-agent workflows, model routing, LLM provider frameworks, scalable distributed systems, Kubernetes

Preferred skills

on-prem and private cloud environments, storage systems, embedded databases, filesystem abstractions, code execution sandboxes, edge inference, browser-native models, open-source contributions to LLM infrastructure, identity and workload auth systems

Technologies

Kubernetes, gVisor, Firecracker, Kata, WASM runtimes

Responsibilities

Build secure execution environments for agent-generated code; Implement identity, authentication, and trust boundaries for agents; Develop model routing and orchestration across different model types; Manage rate limiting, quotas, and resource management for agent workflows; Create state management, memory, and filesystem abstractions for agents.

Seniority

Senior, hands-on IC

Sourced via ashby · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.
Apply on Ashby ↗