CareerPlan

Sr. Staff Software Engineer, Product ML Infrastructure

Palo AltoFull-time$245k2026-10-06 → 2026-11-10
Hybrid

Core

Setting technical vision and roadmap for model training and serving infrastructure, focusing on GPU efficiency and large-scale ranking systems for Ads and Core products.

Role type

Sr. Staff Software Engineer (Product ML Infrastructure)

Builds

Unified data, training, feature, and inference infrastructure; distributed training and high-scale CPU/GPU inference platforms.

Domain

AI/ML Infrastructure, Distributed Systems, GPU Optimization, Recommender Systems

Deliverable

production ML models

Required skills

Distributed ML systems, GPU performance optimization, Systems programming (C++, Java, Python), Large-scale training and inference, AI/ML modeling, Cross-organizational architecture

Preferred skills

AI-assisted development and analysis, Mentoring senior engineers

Technologies

C++, Java, Python, GPU kernels, Distributed execution, Quantization, Compilation

Responsibilities

Set technical vision and roadmap for model training and serving; Lead architectures for distributed training and high-scale inference; Improve efficiency across data loading, GPU kernels, and memory; Build reliable, observable platforms; Partner with Ads and Core AI/ML teams to productionize features; Drive cross-organizational architecture decisions and mentor senior engineers.

Seniority

Sr. Staff, hands-on IC with strategy & mentorship