CareerPlan

Distributed Systems Engineer

San FranciscoFull-time$200k–$270k2026-11-08
HybridNo visa sponsorship

Core

Building the runtime and registry for AI/LLM tools, including production-grade integrations, services, and governance models for enterprise systems.

Role type

Senior Distributed Systems Engineer (Backend)

Builds

MCP runtime, tool catalog, actions platform, and governance infrastructure for AI agents

Domain

AI/LLM infrastructure, distributed systems, enterprise security

Deliverable

production ML models

Required skills

Backend development (Python, Go, Ruby, Typescript), API & Web frameworks, Infrastructure & deployment (AWS/GCP, Terraform, Helm), Production API design, Clean code practices, Developer product design

Preferred skills

Developer tools or SDKs, LLMs and AI frameworks, Open-source contributions, High-scale distributed systems, Team leadership, Frontend frameworks (React)

Technologies

Go, Python, Typescript, AWS, GCP, Terraform, Helm, LangChain, LlamaIndex, React

Responsibilities

Build infrastructure to manage the backplane for AI tools, Design and deploy high-performance secure software, Develop SDKs and frameworks for custom tools, Create integrations with major platforms and LLMs, Shape the team roadmap, Build leverage via AI automation

Seniority

Senior, hands-on IC