Senior Backend Engineer - AI Agents
Core
Design and build scalable backend systems, agent orchestration frameworks, and low-latency inference pipelines for real-time AI Agents in enterprise environments.
Role type
Senior IC backend engineer (AI agents & distributed systems)
Builds
Scalable backend infrastructure, agent orchestration frameworks, and production-grade AI agent systems for enterprise customers.
Domain
Enterprise customer experience (CX) and AI infrastructure
Deliverable
production ML models | product features | infrastructure
Required skills
Distributed systems design, real-time processing/streaming, API design (REST/gRPC), microservices, SQL/NoSQL data modeling, Docker/Kubernetes, cloud platforms (AWS/GCP/Azure), system design, concurrency, performance optimization
Preferred skills
LLM/SLM integration, agent frameworks (tool calling, multi-step reasoning), RAG/vector databases, evaluation systems (offline/online evals), prompting strategies, real-time decisioning, workflow orchestration
Technologies
LLMs, SLMs, Docker, Kubernetes, AWS, GCP, Azure, REST, gRPC, SQL, NoSQL, vector databases
Responsibilities
Design and build scalable backend systems for real-time AI Agents; Develop agent orchestration frameworks for multi-step reasoning and tool usage; Architect agent memory, context management, and state persistence; Implement low-latency inference pipelines integrating LLMs/SLMs; Build evaluation frameworks to measure agent performance; Enable continuous improvement loops (feedback → retraining → deployment); Design and manage event-driven, asynchronous workflows; Optimize systems for high throughput and cost-efficient inference; Build and maintain robust APIs and service layers; Partner with Applied AI/ML teams to productionize models; Collaborate with Product/Solutions teams to translate workflows into agentic systems; Drive best practices in observability, monitoring, safety, and guardrails.
Seniority
Senior, hands-on IC