Tyk pump stopped working intermediately

Hello @Sarvesh_Jain and welcome to the community :partying_face:

I remember seeing a similar issue like this. Depending on the severity, you may only loose the analytics record being written at that moment or you may loose further analytics because your pump instance would completely halt. A restart is usually the only way to recover the system, as you may have experienced.

From the logs it appears the Kafka pump is taking a while to complete write to your Kafka data sink. A potential cause of this could be that your Kafka back end was down at the time or experiencing some kind of network issue. The crux of the issue is that pump is finding it difficult to send analytics data to your target.

As the logs mentions, you would need to set a timeout value. I recommend setting a timeout value for both pump and the Kafka engine responsible for writing the data

Note
Please observe that the Kafka engine timeout is in duration and not int. Meaning the 4s, 1m, and 100ms are valid values (a fix to sync the type of the timeout values across the board is coming out in pump v1.8.2 out in pump v1.8.3).

Also ensure that purge_delay > pump_timeout > kafka_engine_timeout

Let us know if this helps