CareerPlanSign in

Senior Backend Developer - Java, Microservices, Gen AI

East York, Toronto💼 Full-time🗓 2026-05-27 → 2026-08-08

Core

Design, develop, and maintain high-performance backend services integrating Generative AI and LLM capabilities into enterprise-scale applications.

Role type

Senior Backend Developer (Java, Microservices, Gen AI)

Builds

RESTful and event-driven APIs, AI inference orchestration layers, RAG services, and secure integrations with AI platforms.

Domain

Enterprise software development, Generative AI, Cloud-native infrastructure

Deliverable

production ML models | product features

Required skills

Java 17+, Spring Boot, Microservices architecture, REST API design, Prompt engineering, RAG implementation, AI inference orchestration, SQL/NoSQL databases, Containerization (Docker/Kubernetes), CI/CD pipelines, OAuth 2.0/JWT security

Preferred skills

Experience with Azure/AWS, Vector stores and embeddings, AI governance in regulated environments

Technologies

Java, Spring Boot, Angular, Docker, Kubernetes, OpenShift, Azure, AWS, PostgreSQL, MongoDB, DB2, OpenAPI/Swagger

Responsibilities

Design and optimize prompt templates and pipelines for LLM integration; Build secure API integrations with AI platforms; Implement RAG services and AI inference orchestration layers; Ensure scalability, resiliency, and observability of backend systems; Contribute to CI/CD pipelines and cloud-native deployments; Troubleshoot complex backend or AI integration issues.

Seniority

Senior, hands-on IC

Sourced via adzuna · Listed on CareerPlan, which tracks 70,000+ jobs from 20+ sources.