CareerPlan

System Software Engineer - AI

MontrealFull-timeCA$120k–CA$180k2026-10-14 → 2026-11-20
Hybrid · Canada

Core

Design and implement communication and execution primitives to enable large-scale AI models to run efficiently across thousands of GPUs.

Role type

Senior System Software Engineer (AI Infrastructure)

Builds

Foundational technology layer for large-scale AI data center clusters

Domain

AI Infrastructure / High-Performance Computing

Deliverable

production ML models

Required skills

C++, Python, Systems Programming, Linux, Networking Protocols

Preferred skills

CUDA, Distributed AI Frameworks (PyTorch, JAX, DeepSpeed), Cluster Orchestration, Production Deployment

Technologies

CUDA, PyTorch, JAX, DeepSpeed, vLLM, SGLang, Dynamo, TRT-LLM

Responsibilities

Collaborate across the stack to influence foundational technology design; Identify and resolve performance bottlenecks in distributed training and inference; Conduct rigorous performance benchmarking on multi-node clusters.

Seniority

Senior, hands-on IC