Some connections are failing or dropping by Tyk while proxying

[Olu]

@utkarsh079

We increased resources for upstream service and can see the errors have reduced significantly. But errors are still there since the upstream service is running as pods and whenever a pod’s resource utilization spikes, we are seeing these errors and failure in API requests.

I just noticed you were also observing proxy downstream (http: proxy error: context canceled) and upstream ( http: proxy error: EOF) errors.

http: proxy error: context canceled - > indicates that the upstream connections are being closed unexpectedly. See more details in this document.

@utkarsh079

This did not use to happen previously because Nginx does a retry on its own in such case.

What version are you on? There were some performance regressions in v5.0.9, v5.0.10 and v5.2.5. v5.2.6 had some performance improvements added to it that could help.

@utkarsh079

Are there any parameters or configurations in Tyk that I am missing that could help here

Our planning for production doc can help you get the best out of your gateway. The general rule would be to ensure downstream timeouts are the same as upstream timeouts.

Hope this helps