CareerPlanSign in

Senior Software Engineer, Infrastructure

New York City💼 Full-time🗓 2026-02-08 → 2026-09-26

Core

Architecting a high-uptime, low-latency distributed inference system for a real-time conversational interface (Stream) involving ML and data processing.

Role type

Senior Infrastructure Engineer (Real-time Systems)

Builds

Distributed inference system, data pipelines, observability tools for a consumer-facing voice interface

Domain

Consumer technology, Real-time systems, Machine Learning Infrastructure

Deliverable

production ML models | infrastructure

Required skills

Python, Javascript, Distributed systems architecture, Real-time service development, Observability, Low-latency optimization, Production system ownership

Preferred skills

Experience in big infra teams (Google/Meta), Technical leadership

Technologies

Python, Javascript

Responsibilities

Architect a high-uptime, low-maintenance, and reliable distributed inference system; Lead observability and oncall; Achieve very low latency & jitter with attention to P99 performance; Develop a safe rollout to production process; Implement data pipelines for user-facing features and internal tooling

Seniority

Senior, hands-on IC

Sourced via ashby · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.