Request Management via Tyk Gateway

Support Installation and Deployment
1

I have a backend worker servers which get a request, process that request, and return a result.
The case is that the server only can handle around 100 requests in parallel, so I have 2 separate servers for now.
My guess is that I need a queue management system which will queue requests from users, check if any of server have resources to process the request (api.example.com/status), and send it or put it into a queue.

Is it possible to do it with Tyk gateway?
I’m trying to avoid create another instance just to manage queue

2

Hello @megobari and welcome to the community

The short answer is no. Tyk does not have a built in queue system to help you managed this. You may find more luck looking at some open source messaging queue solution.

Long, complex and cumbersome answer is it probably possible with a combination of custom plugins (to trigger the condition), Redis (to store the queued up requests), multiple gateways and some form of automation.

@Martin Would you like to have a crack?

1 Like
3

Thanks @Olu for the info