CareerPlan

Principal Software Engineering Manager, AI Experiences

United States, New York, New YorkFull-time2026-10-22 → 2026-11-10

Core

Lead and develop a software engineering team focused on building high-performance, low-latency shared-platform services, distributed caching, and real-time infrastructure for machine learning-backed applications.

Role type

Senior IC manager (people management + architectural guidance)

Builds

Reusable services, libraries, interfaces, runtime components, and shared-platform infrastructure for real-time applications.

Domain

Internet / Real-time systems / Distributed infrastructure / Machine Learning serving

Deliverable

production ML models

Required skills

People management, software architecture, distributed systems design, high-performance C/C++ development, Linux systems programming, shared library design, distributed caching, streaming systems, ML integration, cloud infrastructure, CI/CD, observability

Preferred skills

Experience with advertising auctions, traffic shaping, rate limiting, infrastructure modernization, incident response

Technologies

C, C++, C#, Java, JavaScript, Python, Linux, Aerospike, Garnet, Redis, Kafka, Azure, Terraform, Bicep, Puppet, Grafana, OpenTelemetry

Responsibilities

Hire, coach, and grow a team spanning infrastructure, operations, and shared-platform software; Own the team's roadmap and delivery; Guide shared-platform architecture and design of reusable services; Advance low-latency software engineering and concurrency improvements; Lead client and server integration, capacity planning, and observability; Partner with ML teams to integrate model scores into real-time services; Deliver infrastructure-as-code migrations to Azure; Drive operational excellence and incident response; Improve developer productivity and secure delivery.

Seniority

Principal, hands-on IC with people management