Tyk Pump release v1.8

Hello Tyk Community! :raised_hand:

Tyk Pump v1.8.0 has been released today! Here are the details:

:rocket: Highlights
Pump 1.8 introduces two new pumps: The GraphQL SQL Aggregate Pump - which allows you to transfer GraphQL transaction logs to SQL; and Resurface Pump - which allows you to transfer data to Resurface.io for context based security analysis.

We have changed the default MongoDB driver from mgo to mongo-go. The new driver supports MongoDB versions greater or equal to v4. If you are using older version of MongoDB v3.x, please update the driver type here.

We have also added a config option that allow you to decode the raw requests and responses for all pumps so you don’t need to worry about processing them in your data pipeline. For demo mode, there is now an option to generate future data for your convenience.

Notes on MongoDB v3.x compatibility

We have changed the default MongoDB driver from mgo to mongo-go. The new driver supports MongoDB versions greater or equal to v4. If you are using older version of MongoDB v3.x, please update the driver type here.

:feather: New Features

  1. Added GraphQL SQL Aggregate Pump
  2. Added Resurface Pump - Resurface can provide context-based security analysis for attack and failure triage, root cause, threat and risk identification base on detail API logs sent from Tyk Pump.
  3. Add config option raw_request_decoded and raw_response_decoded for decoding from base64 the raw requests/responses fields before writing to Pump. This is useful if you want to search for specific values in the raw request/response. Both are disabled by default. This setting is not available for Mongo and SQL pumps, since dashboard will decode the raw request/response.
  4. Add ability to generate future data in demo mode using --demo-future-data flag.
  5. Hybrid Pump refactoring - we now have better RPC connection control, testability, and documentation
  6. Remove critical CVE go.uuid vulnerability
  7. Use latest Tyk storage library to connect to Mongo

:hammer_and_wrench: Fixes

  1. Std pump does not log accurate time when set to json format
  2. GraphPump doesn’t include names of queries/mutation and subscriptions called
  3. Mongo Pump’s connection hangs forever if misconfigured

:pencil: Installation/Upgrade instructions
More details here: Tyk Pump Configuration
Additional resources: GitHub - TykTechnologies/tyk-pump: Tyk Analytics Pump to move analytics data from Redis to any supported back end (multiple back ends can be written to at once).
Changelog: Release v1.8.0 · TykTechnologies/tyk-pump · GitHub

Still seeing issues with Tyk-Pump? Please visit our Github repository and submit an issue- our Engineers will be more than happy to help!

:speech_balloon: Feedback
Don’t forget to star us on Github and Artifacthub!

3 Likes