Sr. Staff Software Engineer, AI Infrastructure
Core
Building next-gen AI training and serving infrastructure to scale large models (hundreds of billions of parameters) for recommendation, LLM, and computer vision use cases.
Role type
Sr. Staff Software Engineer (AI Infrastructure)
Builds
High-performance distributed training pipelines, low-latency GPU inference platforms, and containerized orchestration for AI models.
Domain
AI/ML Infrastructure, Large Scale Distributed Systems, GPU Computing
Deliverable
production ML models
Required skills
Distributed systems architecture, Deep learning frameworks (PyTorch, TensorFlow), GPU optimization, Open source contribution, Technical leadership, System observability
Preferred skills
PhD in CS, LLM serving expertise, Kubeflow/MLFlow, JAX/FLAX, GNNs, Incremental Learning
Technologies
PyTorch, TensorFlow, DeepSpeed, vLLM, Ray, Horovod, CUDA, Kubernetes, Docker
Responsibilities
Design and implement high-performance data I/O for distributed training; Optimize GPU-based inference for high QPS; Mentor engineers and define technical strategy; Collaborate with open-source communities; Lead concurrent key initiatives for AI platforms.
Seniority
Sr. Staff, hands-on IC with technical leadership