Additional Elasticsearch Data

catdevnull 2016-12-19 10:04:17 UTC #1

Hi,

We've just configured the Pump to push stats into our ELK stack and I've noticed that the stats it does push are limited compared to what you can see in Dashboard.

The missing information as far as I can see is things like:

Request Headers & Payload
Response Headers & Payload
Access Token
Tags

Is there any way to configure Tyk Pump to push this data into Elasticsearch?

Thanks,
Richard

Martin 2016-12-19 11:07:45 UTC #2

Hi Richard,

I'm afraid not - the ElasticSearch pump is community-provided, it should be quite easy to extend:

github.com

TykTechnologies/tyk-pump/blob/master/pumps/elasticsearch.go

package pumps

import (
	"github.com/TykTechnologies/logrus"
	"github.com/TykTechnologies/tyk-pump/analytics"
	"github.com/mitchellh/mapstructure"
	"gopkg.in/olivere/elastic.v3"
	"time"
)

type ElasticsearchPump struct {
	esClient *elastic.Client
	esConf   *ElasticsearchConf
}

var elasticsearchPrefix string = "elasticsearch-pump"

type ElasticsearchConf struct {
	IndexName        string `mapstructure:"index_name"`
	ElasticsearchURL string `mapstructure:"elasticsearch_url"`

This file has been truncated. show original

catdevnull 2016-12-19 11:09:08 UTC #3

Thanks @martin I'll have a look at it!

catdevnull 2016-12-21 13:29:46 UTC #4

For anyone who refers to this forum post changes to support this have now been accepted onto the develop branch: