Senior Software Engineer (Go/Ruby)
Core
Design and develop high-throughput, low-latency MCP Gateway and AI Gateway production services for applications, AI agents, and LLM providers.
Role type
Senior Software Engineer (Go/Ruby)
Builds
MCP Gateway and AI Gateway production services
Domain
AI Infrastructure / Distributed Systems
Deliverable
production ML models
Required skills
Go, Ruby, PostgreSQL, Kubernetes, TCP, TLS, HTTP, JSON streaming, connection pooling, backpressure, concurrency, profiling, debugging, observability, LLM integration, MCP protocol, OpenAI-compatible APIs, Anthropic APIs
Preferred skills
MCP server or client integration, transport and capability negotiation
Technologies
Go, Ruby, PostgreSQL, Kubernetes, TCP, TLS, HTTP, JSON, OpenAI, Anthropic
Responsibilities
Design and develop MCP Gateway and AI Gateway production services; Implement protocol-level capabilities including MCP clients and servers, request routing, streaming, tool-call proxying, authentication and authorization, and tenant isolation; Build high-throughput, low-latency network services involving TCP, TLS, HTTP, JSON streaming, connection pooling, and backpressure; Own application-side PostgreSQL schema design, indexing, query planning, transactions, isolation, connection management, and migrations at scale; Design concurrent systems using worker pools, queues, graceful shutdown, backpressure, and race-free shared state; Profile services under load and resolve performance bottlenecks involving allocations, garbage collection, lock contention, and query performance; Build observability for AI systems covering metrics, tracing, logging, token usage, provider latency, cache hit rates, failure modes, and cost per request; Deploy, debug, monitor, and continuously improve reliable distributed services in containerized environments; Participate in technical design discussions and code reviews, and help shape AI-assisted development workflows and internal tooling.
Seniority
Senior, hands-on IC