CareerPlan

Senior Software Engineer, Inference

Boston / Canada / Europe / New York City / North America …RemoteFull-time$190k–$225k2026-10-21 → 2026-11-06
HybridNo visa sponsorship

Core

Design and ship customer-facing APIs that expose new AI model capabilities, scaling inference infrastructure to support 1M+ users.

Role type

Senior Software Engineer (Inference & API)

Builds

Production APIs, inference infrastructure, SDKs, and internal tooling for AI models.

Domain

Artificial Intelligence / Machine Learning / Cloud Infrastructure

Deliverable

production ML models

Required skills

Backend engineering, Machine learning infrastructure, API design, Scalability, Cross-functional collaboration

Preferred skills

Ambiguity tolerance, Curiosity about AI/ML

Technologies

None explicitly listed

Responsibilities

Design and ship customer-facing APIs, Scale inference infrastructure, Partner with researchers to productionize techniques, Contribute across the stack (backend, SDKs, tooling)