Sr Software Engineer - GenAI Gateway - IT
Core
Design and develop scalable backend solutions for integrating generative AI models, serving approximately 400 applications and thousands of internal users.
Role type
Senior Software Engineer (GenAI Gateway)
Builds
Scalable backend interfaces and distributed architectures for GenAI model integration
Domain
Financial services / Generative AI infrastructure
Deliverable
production ML models
Required skills
Go, Java, microservices, REST APIs, distributed systems, automated testing, SQL, NoSQL, Redis, site reliability engineering, observability, performance tuning
Preferred skills
Generative AI, language models, Fury services, Datadog, Kibana, BigQuery
Responsibilities
Design and develop scalable backend solutions for GenAI model integration; Implement and optimize asynchronous processing, streaming, and batch processing systems; Ensure platform availability and reliability through resilience mechanisms and incident management; Evolve GenAI Gateway capabilities by integrating new models and optimizing costs.