Question regarding opensearch

[alon_hen]

TYK_PMP_OMITCONFIGFILE = true
TYK_PMP_PURGEDELAY = 2
TYK_PMP_PUMPS_ELASTICSEARCH_META_DECODEBASE64 = true
TYK_PMP_ANALYTICSSTORAGECONFIG_HOST = http://url
TYK_PMP_ANALYTICSSTORAGECONFIG_PORT = value
TYK_PMP_ANALYTICSSTORAGECONFIG_PASSWORD = value
TYK_PMP_ANALYTICSSTORAGECONFIG_REDISUSESSL = true
TYK_PMP_DONTPURGEUPTIMEDATA = true
TYK_PMP_PUMPS_MAIN_TYPE = mongo
TYK_PMP_PUMPS_MAIN_META_COLLECTIONNAME = tyk_analytics
TYK_PMP_PUMPS_ELASTICSEARCH_TYPE = elasticsearch
TYK_PMP_PUMPS_ELASTICSEARCH_META_ELASTICSEARCHURL = http://urlhere:9200
TYK_PMP_PUMPS_ELASTICSEARCH_META_ENABLESNIFFING= true
TYK_PMP_PUMPS_ELASTICSEARCH_META_ROLLINGINDEX = true
TYK_PMP_PUMPS_ELASTICSEARCH_META_EXTENDEDSTATISTICS= true
TYK_PMP_PUMPS_ELASTICSEARCH_META_VERSION = 7 # Elastic version
TYK_PMP_PUMPS_ELASTICSEARCH_META_BULKCONFIG_WORKERS = 2
TYK_PMP_PUMPS_ELASTICSEARCH_META_BULKCONFIG_FLUSHINTERVAL = 10
TYK_PMP_PUMPS_PROMETHEUS_TYPE = prometheus
TYK_PMP_PUMPS_PROMETHEUS_META_ADDR = :9090
TYK_PMP_LOGLEVEL = debug

Hey, i have a local ELK integrated with tyk, and the configs are above, and it’s working great.

Now, were going to use opensearch instead of self managed ELK, and we would first like to know if tyk is capable of integrating with opensearch (AWS managed)?
Seocnd and most important, When im changing the above configuration (with the URL of the opensearch for example)
Besides adding this flag (below) which i assume is a must :
TYK_PMP_PUMPS_ELASTICSEARCH_META_USESSL

Do i need to add any of these flags aswell (below) , or will it work out of the box just with the Enabling of the SSL connection

TYK_PMP_PUMPS_ELASTICSEARCH_META_SSLINSECURESKIPVERIFY
TYK_PMP_PUMPS_ELASTICSEARCH_META_SSLCERTFILE
TYK_PMP_PUMPS_ELASTICSEARCH_META_SSLKEYFILE

Also, do i need to set this
TYK_PMP_PUMPS_ELASTICSEARCH_TYPE
to “opensearch” or something instead of elasticsearch?

Thanks in advance!

[Ubong]

Hi @alon_hen,

Thank you for your questions.

Yes, it is possible to integrate Tyk with OpenSearch - simple tests show that it works. However, we do not officially support OpenSearch. It’s more of an effect of our support for Elasticsearch rather than a targeted solution.

We are working on OpenTelemetry support which would allow Pump to export data in a vendor-neutral format supported broadly by the industry, including AWS OpenSearch. You can join the conversation in this thread. FAQ: OpenTelemetry & Distributed tracing

For the other questions:

…which i assume is a must TYK_PMP_PUMPS_ELASTICSEARCH_META_USESSL

Yes, _META_USESSL would be required.

Do I need to add any of these flags as well (below) , or will it work out of the box just with the Enabling of the SSL connection

You might need _META_SSLINSECURESKIPVERIFY=true since other AWS products like MemoryDB require it.

I don’t think you would need _META_SSLCERTFILE or _META_SSLKEYFILE.

…do I need to set this TYK_PMP_PUMPS_ELASTICSEARCH_TYPE to “opensearch” or something instead of elasticsearch?

No, you don’t. ‘elasticsearch’ is the one


Let us know how you get on?

[alon_hen]

Hey, thanks for the reply, i did succed integrating tyk with opensearch at the end
I did have to disable the
TYK_PMP_PUMPS_ELASTICSEARCH_META_ENABLESNIFFING= true
to for it to work.