CareerPlanSign in

Senior Software Engineer (Go/Ruby)

USA💼 Full-time🗓 2026-08-31 → 2026-09-26

Core

Design and develop high-throughput, low-latency MCP and AI Gateway production services mediating between applications, AI agents, and LLM providers.

Role type

Senior Software Engineer (Go/Ruby)

Builds

MCP servers, clients, request routing, streaming, tool-call proxying, authentication, authorization, and tenant isolation services.

Domain

AI infrastructure, distributed systems, LLM protocol integration

Deliverable

production ML models | product features

Required skills

Go (standard library, net/http, crypto/tls, goroutines, channels, memory model, GC, networking), Ruby, Rails, ActiveRecord tuning, PostgreSQL (query optimization, indexing, transactions, connection pooling), concurrency, profiling, Kubernetes, containers, LLM protocol integration, MCP server/client integration, OpenAI/Anthropic API integration

Preferred skills

MCP familiarity, LLM output auditing, evolving AI protocol evaluation

Technologies

Go, Ruby, Rails, PostgreSQL, Kubernetes, TCP, TLS, HTTP, JSON streaming

Responsibilities

Design and implement protocol-level functionality for MCP and AI Gateway; build high-throughput network services; own PostgreSQL schema design and optimization; develop observability for AI systems; participate in technical design and code reviews.

Seniority

Senior, hands-on IC

Sourced via codingjobboard · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.