CareerPlanGet AI match score →

Senior Runtime Engineer

US and Canada Offices💼 Full-time🗓 2025-10-28 → 2026-07-31

Core

Design and develop high-performance distributed software to orchestrate massive compute and data pipelines for large-scale AI training and inference workloads.

Role type

Senior IC distributed systems engineer (AI runtime)

Builds

Distributed runtime components and high-performance data/communication pipelines for AI model execution

Domain

AI infrastructure / High-performance computing / Distributed systems

Deliverable

production ML models

Required skills

C/C++ programming, multi-threading, memory management, distributed systems, networking, inter-process communication, system-level resource management, debugging and profiling

Preferred skills

Machine learning training/inference pipelines, Python, PyTorch, compiler internals, custom hardware interfaces, HPC systems

Technologies

C, C++, Python, PyTorch

Responsibilities

Design and implement distributed runtime components; Develop and optimize high-performance data and communication pipelines; Enable scalable execution across multiple compute nodes; Collaborate with ML and compiler teams; Diagnose and resolve complex performance issues; Contribute to system design and architecture reviews

Seniority

Senior, hands-on IC

Sourced via ashby · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.
Apply on Ashby ↗