CareerPlan

Sr. Staff Software Engineer, AI Infrastructure

Sunnyvale, CA, usFull-time$198k2026-09-25 → 2026-11-19
Hybrid · United States

Core

Building next-gen AI training and serving infrastructure to scale large models (hundreds of billions of parameters) for recommendation, LLM, and computer vision use cases.

Role type

Sr. Staff Software Engineer (AI Infrastructure)

Builds

High-performance distributed training pipelines, low-latency GPU inference platforms, and containerized orchestration for AI models.

Domain

AI/ML Infrastructure, Large Scale Distributed Systems, GPU Computing

Deliverable

production ML models

Required skills

Distributed systems architecture, Deep learning frameworks (PyTorch, TensorFlow), GPU optimization, Open source contribution, Technical leadership, System observability

Preferred skills

PhD in CS, LLM serving expertise, Kubeflow/MLFlow, JAX/FLAX, GNNs, Incremental Learning

Technologies

PyTorch, TensorFlow, DeepSpeed, vLLM, Ray, Horovod, CUDA, Kubernetes, Docker

Responsibilities

Design and implement high-performance data I/O for distributed training; Optimize GPU-based inference for high QPS; Mentor engineers and define technical strategy; Collaborate with open-source communities; Lead concurrent key initiatives for AI platforms.

Seniority

Sr. Staff, hands-on IC with technical leadership