CareerPlanGet AI match score →

Senior Software Engineer, Generative AI Systems

US, CA, Santa Clara💼 Full-time🗓 2026-05-27 → 2026-08-01

Core

Design, develop, and evaluate large-scale AI systems powering next-generation applications in LLMs, agentic AI, RAG, and intelligent automation.

Role type

Senior IC software engineer (Generative AI systems)

Builds

Scalable AI infrastructure, distributed systems, cloud-native platforms, and production AI services

Domain

Generative AI, Large Language Models, Distributed Systems, Cloud Infrastructure

Deliverable

production ML models | infrastructure | product features

Required skills

Python, C++, distributed systems, cloud infrastructure, ML frameworks (PyTorch, TensorFlow, JAX, DeepSpeed), Kubernetes, Docker, API development, RAG pipelines, evaluation frameworks

Preferred skills

LLMs, prompt engineering, agentic AI workflows, FastAPI, Node.js, TypeScript

Technologies

FastAPI, Kubernetes, Docker, AWS, GCP, Azure, PyTorch, TensorFlow, JAX, DeepSpeed

Responsibilities

Design scalable infrastructure for ML training and inference; Build distributed systems supporting GPU clusters; Develop evaluation frameworks for LLMs and agentic AI; Architect and optimize RAG pipelines; Build backend services and production AI infrastructure; Develop automated benchmarking and orchestration systems

Seniority

Senior, hands-on IC

Sourced via workday · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.
Apply on Workday ↗