Tyk (1.7) and Consul (1.2.1): it is not working

Our microservices (e.g: myfancy-api) are published in Consul.

With the following query I get a list of valid endpoints:
curl http://analyticsAPIGateway:8080/myfancy-api/

The results look like this when some instances (here: 2) of the microservices are running:
[
{
“ID”: “573305da-5cf9-9b0a-86b0-6e0f819c4efb”,
“Node”: “analyticsKubeWorker1”,
“Address”: “192.168.0.67”,
“Datacenter”: “localcluster”,
“TaggedAddresses”: {
“lan”: “192.168.0.67”,
“wan”: “192.168.0.67”
},
“NodeMeta”: {
“consul-network-segment”: “”
},
“ServiceKind”: “”,
“ServiceID”: “_nomad-task-5p34izfqytbgjf2adhvjqtpiwufcyhua”,
“ServiceName”: “myfancy-api”,
“ServiceTags”: [
“myfancy-api”,
“myfancy”,
“api”
],
“ServiceAddress”: “192.168.0.67”,
“ServiceMeta”: {},
“ServicePort”: 29371,
“ServiceEnableTagOverride”: false,
“ServiceProxyDestination”: “”,
“ServiceConnect”: {
“Native”: false,
“Proxy”: null
},
“CreateIndex”: 9094,
“ModifyIndex”: 9094
},
{
“ID”: “573305da-5cf9-9b0a-86b0-6e0f819c4efb”,
“Node”: “analyticsKubeWorker1”,
“Address”: “192.168.0.67”,
“Datacenter”: “localcluster”,
“TaggedAddresses”: {
“lan”: “192.168.0.67”,
“wan”: “192.168.0.67”
},
“NodeMeta”: {
“consul-network-segment”: “”
},
“ServiceKind”: “”,
“ServiceID”: “_nomad-task-yza32qpsxufnuol5x2mlx7wnmqb3lfs7”,
“ServiceName”: “myfancy-api”,
“ServiceTags”: [
“myfancy-api”,
“myfancy”,
“api”
],
“ServiceAddress”: “192.168.0.67”,
“ServiceMeta”: {},
“ServicePort”: 21338,
“ServiceEnableTagOverride”: false,
“ServiceProxyDestination”: “”,
“ServiceConnect”: {
“Native”: false,
“Proxy”: null
},
“CreateIndex”: 9096,
“ModifyIndex”: 9096
}
]

How can I define an API that reads the service endpoints from Consul and offers them through Tyk?

I have already tried some, but in the best case (if not a 404 occurs) I only get the info: all hosts are down

Thank you
Oliver

Hi

Can you share your api definition so I can check how you’ve configured the service discovery for your api

Also have you tried with these settings on your api?

	isTargetList = true
	endpointReturnsList = true
	portSeperate = true
	dataPath = "Address"
	parentPath = ""
	portPath = "ServicePort"

Hi Josh,

thanks for your quick reply. First of all, my example to get the info from Consul was wrong. It is like this, of course, as Consul is running on a different host with a different port: curl http://analyticsKubeMaster:8500/v1/catalog/service/myfancy-api

Please find below my TykDefinition.json.

With the current configuration I get an error if I try to connect the API (via: curl http://analyticsAPIGateway:8080/myfancy-api/):

“error”: “There was a problem proxying the request”

Any ideas?

Best regards
Oliver

P.S.: Curious that I cannot upload a JSON file and I get an error that I cannot put more than 2 links in one post.

Proxy section within TykDefinition.json:

"proxy": {
    "preserve_host_header": false,
    "listen_path": "/myfancy-api/",
    "target_url": "",
    "strip_listen_path": true,
    "enable_load_balancing": true,
    "target_list": [],
    "check_host_against_uptime_tests": false,
    "service_discovery": {
        "use_discovery_service": true,
        "query_endpoint": "http://analyticsKubeMaster:8500/v1/catalog/service/myfancy-api",
        "use_nested_query": true,
        "parent_data_path": "",
        "data_path": "Address",
        "port_data_path": "ServicePort",
        "target_path": "",
        "use_target_list": true,
        "cache_timeout": 10,
        "endpoint_returns_list": true,
        "isTargetList": true,
        "endpointReturnsList": true,
        "portSeperate": true,
        "dataPath": "Address",
        "parentPath": "",
        "portPath": "ServicePort"
    }

Can you try setting this to false and let me know if their is any change

Hi Josh,

sure. First I cannot change this in the Dashboard as the change is not save if I click on UPDATE. I have to export as a file, change the file and have to import the new API. I assume it is a bug as I mentioned in lexcongs topic.

But back to the change. After that I get the following error:

curl http://192.168.0.69:8080/myfancy-api/

404 Not Found

Not Found

The requested URL was not found on the server. If you entered the URL manually please check your spelling and try again.

As I cannot upload json files please find attached my current configuration as a screenshot.

Can you run a call to the api with debug logs on and see if the 404 is coming from Tyk or your upstream - those logs will also show if Tyks service discovery is constructing the upstream target correctly from the JSON it gets from Consul

How could I do this?

The only parameter I know is “enable_detailed_recording”. And this true already.

Attached you can find the log information from the dashboard:

If you run the gateway with the --debug flag on startup or use the loglevel env var assuming your are using Tyk on premise

Hello, Josh,

hmm, I didn’t find it in the documentary, but after some thinking I could now start Tyk Gateway with --debug.

Well, never mind.

For all others who also want to start the gateway in debug level, simply use the tyk binary from the install folder (usually /opt/tyk-gateway) with:

/opt/tyk-gateway/tyk --conf /opt/tyk-gateway/tyk.conf --debug

Now I have found the error. Josh, you made my day. Thank you very much.

I used the wrong endpoint of the microservice API as the name was the same as the name of the API in tyk. Therefore I played myself out.

Nonetheless, here is the output from the debug level. As you can see, tyk reads Consul correctly.

If you would paste the result into an editor you will find the cluster member of the microservice at line 31. So, everything is fine. But if I would try to use the specific API (hint: And when I had written this sentence, I realized that I had tricked myself.)

Great support, great tool. Awesome.

------------------debug info -------------------------
[Jul 30 16:13:11] DEBUG Getting exp for key: analytics-tyk-system-analytics
[Jul 30 16:13:11] DEBUG Started proxy
[Jul 30 16:13:11] DEBUG Stripping: /myfancy-api/
[Jul 30 16:13:11] DEBUG Upstream Path is:
[Jul 30 16:13:11] DEBUG UPSTREAM REQUEST URL:
[Jul 30 16:13:11] DEBUG First run! Setting cache
[Jul 30 16:13:11] DEBUG → Refreshing
[Jul 30 16:13:11] DEBUG Getting http://analyticsKubeMaster:8500/v1/catalog/service/myfancy-api
[Jul 30 16:13:11] DEBUG Parsing raw data: {“tyk_array”:[{“ID”:“573305da-5cf9-9b0a-86b0-6e0f819c4efb”,“Node”:“analyticsKubeWorker1”,“Address”:“192.168.0.67”,“Datacenter”:“localcluster”,“TaggedAddresses”:{“lan”:“192.168.0.67”,“wan”:“192.168.0.67”},“NodeMeta”:{“consul-network-segment”:“”},“ServiceKind”:“”,“ServiceID”:“_nomad-task-5p34izfqytbgjf2adhvjqtpiwufcyhua”,“ServiceName”:“myfancy-api”,“ServiceTags”:[“myfancy-api”,“myfancy”,“api”],“ServiceAddress”:“192.168.0.67”,“ServiceMeta”:{},“ServicePort”:29371,“ServiceEnableTagOverride”:false,“ServiceProxyDestination”:“”,“ServiceConnect”:{“Native”:false,“Proxy”:null},“CreateIndex”:9094,“ModifyIndex”:9094},{“ID”:“573305da-5cf9-9b0a-86b0-6e0f819c4efb”,“Node”:“analyticsKubeWorker1”,“Address”:“192.168.0.67”,“Datacenter”:“localcluster”,“TaggedAddresses”:{“lan”:“192.168.0.67”,“wan”:“192.168.0.67”},“NodeMeta”:{“consul-network-segment”:“”},“ServiceKind”:“”,“ServiceID”:“_nomad-task-yza32qpsxufnuol5x2mlx7wnmqb3lfs7”,“ServiceName”:“myfancy-api”,“ServiceTags”:[“myfancy-api”,“myfancy”,“api”],“ServiceAddress”:“192.168.0.67”,“ServiceMeta”:{},“ServicePort”:21338,“ServiceEnableTagOverride”:false,“ServiceProxyDestination”:“”,“ServiceConnect”:{“Native”:false,“Proxy”:null},“CreateIndex”:9096,“ModifyIndex”:9096},{“ID”:“7ede99a4-f97d-e84c-47e2-7c7ed1d7e67a”,“Node”:“analyticsKubeWorker2”,“Address”:“192.168.0.68”,“Datacenter”:“localcluster”,“TaggedAddresses”:{“lan”:“192.168.0.68”,“wan”:“192.168.0.68”},“NodeMeta”:{“consul-network-segment”:“”},“ServiceKind”:“”,“ServiceID”:“_nomad-task-lhwea4xq4fnh3agknsh6pbycjhhezcjh”,“ServiceName”:“myfancy-api”,“ServiceTags”:[“myfancy-api”,“myfancy”,“api”],“ServiceAddress”:“192.168.0.68”,“ServiceMeta”:{},“ServicePort”:24602,“ServiceEnableTagOverride”:false,“ServiceProxyDestination”:“”,“ServiceConnect”:{“Native”:false,“Proxy”:null},“CreateIndex”:9097,“ModifyIndex”:9097},{“ID”:“7ede99a4-f97d-e84c-47e2-7c7ed1d7e67a”,“Node”:“analyticsKubeWorker2”,“Address”:“192.168.0.68”,“Datacenter”:“localcluster”,“TaggedAddresses”:{“lan”:“192.168.0.68”,“wan”:“192.168.0.68”},“NodeMeta”:{“consul-network-segment”:“”},“ServiceKind”:“”,“ServiceID”:“_nomad-task-yzbt45lzot6mgu3b4duic4buv7p2xdqc”,“ServiceName”:“myfancy-api”,“ServiceTags”:[“myfancy-api”,“myfancy”,“api”],“ServiceAddress”:“192.168.0.68”,“ServiceMeta”:{},“ServicePort”:26273,“ServiceEnableTagOverride”:false,“ServiceProxyDestination”:“”,“ServiceConnect”:{“Native”:false,“Proxy”:null},“CreateIndex”:9093,“ModifyIndex”:9093},{“ID”:“7ede99a4-f97d-e84c-47e2-7c7ed1d7e67a”,“Node”:“analyticsKubeWorker2”,“Address”:“192.168.0.68”,“Datacenter”:“localcluster”,“TaggedAddresses”:{“lan”:“192.168.0.68”,“wan”:“192.168.0.68”},“NodeMeta”:{“consul-network-segment”:“”},“ServiceKind”:“”,“ServiceID”:“_nomad-task-zeq2gc7sxz2naxrfuo2yecnf6ohhucis”,“ServiceName”:“myfancy-api”,“ServiceTags”:[“myfancy-api”,“myfancy”,“api”],“ServiceAddress”:“192.168.0.68”,“ServiceMeta”:{},“ServicePort”:26723,“ServiceEnableTagOverride”:false,“ServiceProxyDestination”:“”,“ServiceConnect”:{“Native”:false,“Proxy”:null},“CreateIndex”:9095,“ModifyIndex”:9095}]}
[Jul 30 16:13:11] DEBUG Got:{“tyk_array”:[{“Address”:“192.168.0.67”,“CreateIndex”:9094,“Datacenter”:“localcluster”,“ID”:“573305da-5cf9-9b0a-86b0-6e0f819c4efb”,“ModifyIndex”:9094,“Node”:“analyticsKubeWorker1”,“NodeMeta”:{“consul-network-segment”:“”},“ServiceAddress”:“192.168.0.67”,“ServiceConnect”:{“Native”:false,“Proxy”:null},“ServiceEnableTagOverride”:false,“ServiceID”:“_nomad-task-5p34izfqytbgjf2adhvjqtpiwufcyhua”,“ServiceKind”:“”,“ServiceMeta”:{},“ServiceName”:“myfancy-api”,“ServicePort”:29371,“ServiceProxyDestination”:“”,“ServiceTags”:[“myfancy-api”,“myfancy”,“api”],“TaggedAddresses”:{“lan”:“192.168.0.67”,“wan”:“192.168.0.67”}},{“Address”:“192.168.0.67”,“CreateIndex”:9096,“Datacenter”:“localcluster”,“ID”:“573305da-5cf9-9b0a-86b0-6e0f819c4efb”,“ModifyIndex”:9096,“Node”:“analyticsKubeWorker1”,“NodeMeta”:{“consul-network-segment”:“”},“ServiceAddress”:“192.168.0.67”,“ServiceConnect”:{“Native”:false,“Proxy”:null},“ServiceEnableTagOverride”:false,“ServiceID”:“_nomad-task-yza32qpsxufnuol5x2mlx7wnmqb3lfs7”,“ServiceKind”:“”,“ServiceMeta”:{},“ServiceName”:“myfancy-api”,“ServicePort”:21338,“ServiceProxyDestination”:“”,“ServiceTags”:[“myfancy-api”,“myfancy”,“api”],“TaggedAddresses”:{“lan”:“192.168.0.67”,“wan”:“192.168.0.67”}},{“Address”:“192.168.0.68”,“CreateIndex”:9097,“Datacenter”:“localcluster”,“ID”:“7ede99a4-f97d-e84c-47e2-7c7ed1d7e67a”,“ModifyIndex”:9097,“Node”:“analyticsKubeWorker2”,“NodeMeta”:{“consul-network-segment”:“”},“ServiceAddress”:“192.168.0.68”,“ServiceConnect”:{“Native”:false,“Proxy”:null},“ServiceEnableTagOverride”:false,“ServiceID”:“_nomad-task-lhwea4xq4fnh3agknsh6pbycjhhezcjh”,“ServiceKind”:“”,“ServiceMeta”:{},“ServiceName”:“myfancy-api”,“ServicePort”:24602,“ServiceProxyDestination”:“”,“ServiceTags”:[“myfancy-api”,“myfancy”,“api”],“TaggedAddresses”:{“lan”:“192.168.0.68”,“wan”:“192.168.0.68”}},{“Address”:“192.168.0.68”,“CreateIndex”:9093,“Datacenter”:“localcluster”,“ID”:“7ede99a4-f97d-e84c-47e2-7c7ed1d7e67a”,“ModifyIndex”:9093,“Node”:“analyticsKubeWorker2”,“NodeMeta”:{“consul-network-segment”:“”},“ServiceAddress”:“192.168.0.68”,“ServiceConnect”:{“Native”:false,“Proxy”:null},“ServiceEnableTagOverride”:false,“ServiceID”:“_nomad-task-yzbt45lzot6mgu3b4duic4buv7p2xdqc”,“ServiceKind”:“”,“ServiceMeta”:{},“ServiceName”:“myfancy-api”,“ServicePort”:26273,“ServiceProxyDestination”:“”,“ServiceTags”:[“myfancy-api”,“myfancy”,“api”],“TaggedAddresses”:{“lan”:“192.168.0.68”,“wan”:“192.168.0.68”}},{“Address”:“192.168.0.68”,“CreateIndex”:9095,“Datacenter”:“localcluster”,“ID”:“7ede99a4-f97d-e84c-47e2-7c7ed1d7e67a”,“ModifyIndex”:9095,“Node”:“analyticsKubeWorker2”,“NodeMeta”:{“consul-network-segment”:“”},“ServiceAddress”:“192.168.0.68”,“ServiceConnect”:{“Native”:false,“Proxy”:null},“ServiceEnableTagOverride”:false,“ServiceID”:“_nomad-task-zeq2gc7sxz2naxrfuo2yecnf6ohhucis”,“ServiceKind”:“”,“ServiceMeta”:{},“ServiceName”:“myfancy-api”,“ServicePort”:26723,“ServiceProxyDestination”:“”,“ServiceTags”:[“myfancy-api”,“myfancy”,“api”],“TaggedAddresses”:{“lan”:“192.168.0.68”,“wan”:“192.168.0.68”}}]}
[Jul 30 16:13:11] DEBUG Parsed object list: {map[tyk_array:[map[TaggedAddresses:map[lan:192.168.0.67 wan:192.168.0.67] ServiceTags:[myfancy-api myfancy api] ServiceAddress:192.168.0.67 ServicePort:29371 ServiceProxyDestination: Node:analyticsKubeWorker1 NodeMeta:map[consul-network-segment:] ServiceConnect:map[Native:false Proxy:] ID:573305da-5cf9-9b0a-86b0-6e0f819c4efb Datacenter:localcluster ServiceID:_nomad-task-5p34izfqytbgjf2adhvjqtpiwufcyhua ServiceName:myfancy-api ServiceMeta:map CreateIndex:9094 Address:192.168.0.67 ServiceKind: ServiceEnableTagOverride:false ModifyIndex:9094] map[TaggedAddresses:map[lan:192.168.0.67 wan:192.168.0.67] ServiceAddress:192.168.0.67 ServiceEnableTagOverride:false ServiceConnect:map[Native:false Proxy:] CreateIndex:9096 Datacenter:localcluster ServiceID:_nomad-task-yza32qpsxufnuol5x2mlx7wnmqb3lfs7 ServiceMeta:map ServiceName:myfancy-api ServiceTags:[myfancy-api myfancy api] ServicePort:21338 ID:573305da-5cf9-9b0a-86b0-6e0f819c4efb Node:analyticsKubeWorker1 Address:192.168.0.67 ModifyIndex:9096 NodeMeta:map[consul-network-segment:] ServiceKind: ServiceProxyDestination:] map[ServiceID:_nomad-task-lhwea4xq4fnh3agknsh6pbycjhhezcjh ServiceMeta:map CreateIndex:9097 Address:192.168.0.68 NodeMeta:map[consul-network-segment:] ServiceKind: ServiceAddress:192.168.0.68 ServicePort:24602 ServiceConnect:map[Native:false Proxy:] ID:7ede99a4-f97d-e84c-47e2-7c7ed1d7e67a TaggedAddresses:map[lan:192.168.0.68 wan:192.168.0.68] ServiceTags:[myfancy-api myfancy api] ServiceEnableTagOverride:false ServiceProxyDestination: ModifyIndex:9097 Node:analyticsKubeWorker2 ServiceName:myfancy-api Datacenter:localcluster] map[TaggedAddresses:map[lan:192.168.0.68 wan:192.168.0.68] ServiceAddress:192.168.0.68 ServiceMeta:map ModifyIndex:9093 Node:analyticsKubeWorker2 NodeMeta:map[consul-network-segment:] ServiceID:_nomad-task-yzbt45lzot6mgu3b4duic4buv7p2xdqc ServicePort:26273 ServiceProxyDestination: ServiceConnect:map[Native:false Proxy:] CreateIndex:9093 ServiceEnableTagOverride:false ID:7ede99a4-f97d-e84c-47e2-7c7ed1d7e67a Address:192.168.0.68 Datacenter:localcluster ServiceKind: ServiceName:myfancy-api ServiceTags:[myfancy-api myfancy api]] map[Datacenter:localcluster ServiceAddress:192.168.0.68 ServiceKind: ServiceID:_nomad-task-zeq2gc7sxz2naxrfuo2yecnf6ohhucis ServiceEnableTagOverride:false ServiceProxyDestination: CreateIndex:9095 ModifyIndex:9095 Address:192.168.0.68 TaggedAddresses:map[lan:192.168.0.68 wan:192.168.0.68] ID:7ede99a4-f97d-e84c-47e2-7c7ed1d7e67a ServiceMeta:map ServiceName:myfancy-api ServiceTags:[myfancy-api myfancy api] ServicePort:26723 ServiceConnect:map[Native:false Proxy:] Node:analyticsKubeWorker2 NodeMeta:map[consul-network-segment:]]]]}
[Jul 30 16:13:11] DEBUG Array Namespace: tyk_array
[Jul 30 16:13:11] DEBUG Container: {“tyk_array”:[{“Address”:“192.168.0.67”,“CreateIndex”:9094,“Datacenter”:“localcluster”,“ID”:“573305da-5cf9-9b0a-86b0-6e0f819c4efb”,“ModifyIndex”:9094,“Node”:“analyticsKubeWorker1”,“NodeMeta”:{“consul-network-segment”:“”},“ServiceAddress”:“192.168.0.67”,“ServiceConnect”:{“Native”:false,“Proxy”:null},“ServiceEnableTagOverride”:false,“ServiceID”:“_nomad-task-5p34izfqytbgjf2adhvjqtpiwufcyhua”,“ServiceKind”:“”,“ServiceMeta”:{},“ServiceName”:“myfancy-api”,“ServicePort”:29371,“ServiceProxyDestination”:“”,“ServiceTags”:[“myfancy-api”,“myfancy”,“api”],“TaggedAddresses”:{“lan”:“192.168.0.67”,“wan”:“192.168.0.67”}},{“Address”:“192.168.0.67”,“CreateIndex”:9096,“Datacenter”:“localcluster”,“ID”:“573305da-5cf9-9b0a-86b0-6e0f819c4efb”,“ModifyIndex”:9096,“Node”:“analyticsKubeWorker1”,“NodeMeta”:{“consul-network-segment”:“”},“ServiceAddress”:“192.168.0.67”,“ServiceConnect”:{“Native”:false,“Proxy”:null},“ServiceEnableTagOverride”:false,“ServiceID”:“_nomad-task-yza32qpsxufnuol5x2mlx7wnmqb3lfs7”,“ServiceKind”:“”,“ServiceMeta”:{},“ServiceName”:“myfancy-api”,“ServicePort”:21338,“ServiceProxyDestination”:“”,“ServiceTags”:[“myfancy-api”,“myfancy”,“api”],“TaggedAddresses”:{“lan”:“192.168.0.67”,“wan”:“192.168.0.67”}},{“Address”:“192.168.0.68”,“CreateIndex”:9097,“Datacenter”:“localcluster”,“ID”:“7ede99a4-f97d-e84c-47e2-7c7ed1d7e67a”,“ModifyIndex”:9097,“Node”:“analyticsKubeWorker2”,“NodeMeta”:{“consul-network-segment”:“”},“ServiceAddress”:“192.168.0.68”,“ServiceConnect”:{“Native”:false,“Proxy”:null},“ServiceEnableTagOverride”:false,“ServiceID”:“_nomad-task-lhwea4xq4fnh3agknsh6pbycjhhezcjh”,“ServiceKind”:“”,“ServiceMeta”:{},“ServiceName”:“myfancy-api”,“ServicePort”:24602,“ServiceProxyDestination”:“”,“ServiceTags”:[“myfancy-api”,“myfancy”,“api”],“TaggedAddresses”:{“lan”:“192.168.0.68”,“wan”:“192.168.0.68”}},{“Address”:“192.168.0.68”,“CreateIndex”:9093,“Datacenter”:“localcluster”,“ID”:“7ede99a4-f97d-e84c-47e2-7c7ed1d7e67a”,“ModifyIndex”:9093,“Node”:“analyticsKubeWorker2”,“NodeMeta”:{“consul-network-segment”:“”},“ServiceAddress”:“192.168.0.68”,“ServiceConnect”:{“Native”:false,“Proxy”:null},“ServiceEnableTagOverride”:false,“ServiceID”:“_nomad-task-yzbt45lzot6mgu3b4duic4buv7p2xdqc”,“ServiceKind”:“”,“ServiceMeta”:{},“ServiceName”:“myfancy-api”,“ServicePort”:26273,“ServiceProxyDestination”:“”,“ServiceTags”:[“myfancy-api”,“myfancy”,“api”],“TaggedAddresses”:{“lan”:“192.168.0.68”,“wan”:“192.168.0.68”}},{“Address”:“192.168.0.68”,“CreateIndex”:9095,“Datacenter”:“localcluster”,“ID”:“7ede99a4-f97d-e84c-47e2-7c7ed1d7e67a”,“ModifyIndex”:9095,“Node”:“analyticsKubeWorker2”,“NodeMeta”:{“consul-network-segment”:“”},“ServiceAddress”:“192.168.0.68”,“ServiceConnect”:{“Native”:false,“Proxy”:null},“ServiceEnableTagOverride”:false,“ServiceID”:“_nomad-task-zeq2gc7sxz2naxrfuo2yecnf6ohhucis”,“ServiceKind”:“”,“ServiceMeta”:{},“ServiceName”:“myfancy-api”,“ServicePort”:26723,“ServiceProxyDestination”:“”,“ServiceTags”:[“myfancy-api”,“myfancy”,“api”],“TaggedAddresses”:{“lan”:“192.168.0.68”,“wan”:“192.168.0.68”}}]}
[Jul 30 16:13:11] DEBUG Array value:[{“Address”:“192.168.0.67”,“CreateIndex”:9094,“Datacenter”:“localcluster”,“ID”:“573305da-5cf9-9b0a-86b0-6e0f819c4efb”,“ModifyIndex”:9094,“Node”:“analyticsKubeWorker1”,“NodeMeta”:{“consul-network-segment”:“”},“ServiceAddress”:“192.168.0.67”,“ServiceConnect”:{“Native”:false,“Proxy”:null},“ServiceEnableTagOverride”:false,“ServiceID”:“_nomad-task-5p34izfqytbgjf2adhvjqtpiwufcyhua”,“ServiceKind”:“”,“ServiceMeta”:{},“ServiceName”:“myfancy-api”,“ServicePort”:29371,“ServiceProxyDestination”:“”,“ServiceTags”:[“myfancy-api”,“myfancy”,“api”],“TaggedAddresses”:{“lan”:“192.168.0.67”,“wan”:“192.168.0.67”}} {“Address”:“192.168.0.67”,“CreateIndex”:9096,“Datacenter”:“localcluster”,“ID”:“573305da-5cf9-9b0a-86b0-6e0f819c4efb”,“ModifyIndex”:9096,“Node”:“analyticsKubeWorker1”,“NodeMeta”:{“consul-network-segment”:“”},“ServiceAddress”:“192.168.0.67”,“ServiceConnect”:{“Native”:false,“Proxy”:null},“ServiceEnableTagOverride”:false,“ServiceID”:“_nomad-task-yza32qpsxufnuol5x2mlx7wnmqb3lfs7”,“ServiceKind”:“”,“ServiceMeta”:{},“ServiceName”:“myfancy-api”,“ServicePort”:21338,“ServiceProxyDestination”:“”,“ServiceTags”:[“myfancy-api”,“myfancy”,“api”],“TaggedAddresses”:{“lan”:“192.168.0.67”,“wan”:“192.168.0.67”}} {“Address”:“192.168.0.68”,“CreateIndex”:9097,“Datacenter”:“localcluster”,“ID”:“7ede99a4-f97d-e84c-47e2-7c7ed1d7e67a”,“ModifyIndex”:9097,“Node”:“analyticsKubeWorker2”,“NodeMeta”:{“consul-network-segment”:“”},“ServiceAddress”:“192.168.0.68”,“ServiceConnect”:{“Native”:false,“Proxy”:null},“ServiceEnableTagOverride”:false,“ServiceID”:“_nomad-task-lhwea4xq4fnh3agknsh6pbycjhhezcjh”,“ServiceKind”:“”,“ServiceMeta”:{},“ServiceName”:“myfancy-api”,“ServicePort”:24602,“ServiceProxyDestination”:“”,“ServiceTags”:[“myfancy-api”,“myfancy”,“api”],“TaggedAddresses”:{“lan”:“192.168.0.68”,“wan”:“192.168.0.68”}} {“Address”:“192.168.0.68”,“CreateIndex”:9093,“Datacenter”:“localcluster”,“ID”:“7ede99a4-f97d-e84c-47e2-7c7ed1d7e67a”,“ModifyIndex”:9093,“Node”:“analyticsKubeWorker2”,“NodeMeta”:{“consul-network-segment”:“”},“ServiceAddress”:“192.168.0.68”,“ServiceConnect”:{“Native”:false,“Proxy”:null},“ServiceEnableTagOverride”:false,“ServiceID”:“_nomad-task-yzbt45lzot6mgu3b4duic4buv7p2xdqc”,“ServiceKind”:“”,“ServiceMeta”:{},“ServiceName”:“myfancy-api”,“ServicePort”:26273,“ServiceProxyDestination”:“”,“ServiceTags”:[“myfancy-api”,“myfancy”,“api”],“TaggedAddresses”:{“lan”:“192.168.0.68”,“wan”:“192.168.0.68”}} {“Address”:“192.168.0.68”,“CreateIndex”:9095,“Datacenter”:“localcluster”,“ID”:“7ede99a4-f97d-e84c-47e2-7c7ed1d7e67a”,“ModifyIndex”:9095,“Node”:“analyticsKubeWorker2”,“NodeMeta”:{“consul-network-segment”:“”},“ServiceAddress”:“192.168.0.68”,“ServiceConnect”:{“Native”:false,“Proxy”:null},“ServiceEnableTagOverride”:false,“ServiceID”:“_nomad-task-zeq2gc7sxz2naxrfuo2yecnf6ohhucis”,“ServiceKind”:“”,“ServiceMeta”:{},“ServiceName”:“myfancy-api”,“ServicePort”:26723,“ServiceProxyDestination”:“”,“ServiceTags”:[“myfancy-api”,“myfancy”,“api”],“TaggedAddresses”:{“lan”:“192.168.0.68”,“wan”:“192.168.0.68”}}]
[Jul 30 16:13:11] DEBUG set: [{“Address”:“192.168.0.67”,“CreateIndex”:9094,“Datacenter”:“localcluster”,“ID”:“573305da-5cf9-9b0a-86b0-6e0f819c4efb”,“ModifyIndex”:9094,“Node”:“analyticsKubeWorker1”,“NodeMeta”:{“consul-network-segment”:“”},“ServiceAddress”:“192.168.0.67”,“ServiceConnect”:{“Native”:false,“Proxy”:null},“ServiceEnableTagOverride”:false,“ServiceID”:“_nomad-task-5p34izfqytbgjf2adhvjqtpiwufcyhua”,“ServiceKind”:“”,“ServiceMeta”:{},“ServiceName”:“myfancy-api”,“ServicePort”:29371,“ServiceProxyDestination”:“”,“ServiceTags”:[“myfancy-api”,“myfancy”,“api”],“TaggedAddresses”:{“lan”:“192.168.0.67”,“wan”:“192.168.0.67”}} {“Address”:“192.168.0.67”,“CreateIndex”:9096,“Datacenter”:“localcluster”,“ID”:“573305da-5cf9-9b0a-86b0-6e0f819c4efb”,“ModifyIndex”:9096,“Node”:“analyticsKubeWorker1”,“NodeMeta”:{“consul-network-segment”:“”},“ServiceAddress”:“192.168.0.67”,“ServiceConnect”:{“Native”:false,“Proxy”:null},“ServiceEnableTagOverride”:false,“ServiceID”:“_nomad-task-yza32qpsxufnuol5x2mlx7wnmqb3lfs7”,“ServiceKind”:“”,“ServiceMeta”:{},“ServiceName”:“myfancy-api”,“ServicePort”:21338,“ServiceProxyDestination”:“”,“ServiceTags”:[“myfancy-api”,“myfancy”,“api”],“TaggedAddresses”:{“lan”:“192.168.0.67”,“wan”:“192.168.0.67”}} {“Address”:“192.168.0.68”,“CreateIndex”:9097,“Datacenter”:“localcluster”,“ID”:“7ede99a4-f97d-e84c-47e2-7c7ed1d7e67a”,“ModifyIndex”:9097,“Node”:“analyticsKubeWorker2”,“NodeMeta”:{“consul-network-segment”:“”},“ServiceAddress”:“192.168.0.68”,“ServiceConnect”:{“Native”:false,“Proxy”:null},“ServiceEnableTagOverride”:false,“ServiceID”:“_nomad-task-lhwea4xq4fnh3agknsh6pbycjhhezcjh”,“ServiceKind”:“”,“ServiceMeta”:{},“ServiceName”:“myfancy-api”,“ServicePort”:24602,“ServiceProxyDestination”:“”,“ServiceTags”:[“myfancy-api”,“myfancy”,“api”],“TaggedAddresses”:{“lan”:“192.168.0.68”,“wan”:“192.168.0.68”}} {“Address”:“192.168.0.68”,“CreateIndex”:9093,“Datacenter”:“localcluster”,“ID”:“7ede99a4-f97d-e84c-47e2-7c7ed1d7e67a”,“ModifyIndex”:9093,“Node”:“analyticsKubeWorker2”,“NodeMeta”:{“consul-network-segment”:“”},“ServiceAddress”:“192.168.0.68”,“ServiceConnect”:{“Native”:false,“Proxy”:null},“ServiceEnableTagOverride”:false,“ServiceID”:“_nomad-task-yzbt45lzot6mgu3b4duic4buv7p2xdqc”,“ServiceKind”:“”,“ServiceMeta”:{},“ServiceName”:“myfancy-api”,“ServicePort”:26273,“ServiceProxyDestination”:“”,“ServiceTags”:[“myfancy-api”,“myfancy”,“api”],“TaggedAddresses”:{“lan”:“192.168.0.68”,“wan”:“192.168.0.68”}} {“Address”:“192.168.0.68”,“CreateIndex”:9095,“Datacenter”:“localcluster”,“ID”:“7ede99a4-f97d-e84c-47e2-7c7ed1d7e67a”,“ModifyIndex”:9095,“Node”:“analyticsKubeWorker2”,“NodeMeta”:{“consul-network-segment”:“”},“ServiceAddress”:“192.168.0.68”,“ServiceConnect”:{“Native”:false,“Proxy”:null},“ServiceEnableTagOverride”:false,“ServiceID”:“_nomad-task-zeq2gc7sxz2naxrfuo2yecnf6ohhucis”,“ServiceKind”:“”,“ServiceMeta”:{},“ServiceName”:“myfancy-api”,“ServicePort”:26723,“ServiceProxyDestination”:“”,“ServiceTags”:[“myfancy-api”,“myfancy”,“api”],“TaggedAddresses”:{“lan”:“192.168.0.68”,“wan”:“192.168.0.68”}}]
[Jul 30 16:13:11] DEBUG Child in list: {“Address”:“192.168.0.67”,“CreateIndex”:9094,“Datacenter”:“localcluster”,“ID”:“573305da-5cf9-9b0a-86b0-6e0f819c4efb”,“ModifyIndex”:9094,“Node”:“analyticsKubeWorker1”,“NodeMeta”:{“consul-network-segment”:“”},“ServiceAddress”:“192.168.0.67”,“ServiceConnect”:{“Native”:false,“Proxy”:null},“ServiceEnableTagOverride”:false,“ServiceID”:“_nomad-task-5p34izfqytbgjf2adhvjqtpiwufcyhua”,“ServiceKind”:“”,“ServiceMeta”:{},“ServiceName”:“myfancy-api”,“ServicePort”:29371,“ServiceProxyDestination”:“”,“ServiceTags”:[“myfancy-api”,“myfancy”,“api”],“TaggedAddresses”:{“lan”:“192.168.0.67”,“wan”:“192.168.0.67”}}
[Jul 30 16:13:11] DEBUG Namespace: Address
[Jul 30 16:13:11] DEBUG Namespace: ServicePort
[Jul 30 16:13:11] DEBUG Child in list: {“Address”:“192.168.0.67”,“CreateIndex”:9096,“Datacenter”:“localcluster”,“ID”:“573305da-5cf9-9b0a-86b0-6e0f819c4efb”,“ModifyIndex”:9096,“Node”:“analyticsKubeWorker1”,“NodeMeta”:{“consul-network-segment”:“”},“ServiceAddress”:“192.168.0.67”,“ServiceConnect”:{“Native”:false,“Proxy”:null},“ServiceEnableTagOverride”:false,“ServiceID”:“_nomad-task-yza32qpsxufnuol5x2mlx7wnmqb3lfs7”,“ServiceKind”:“”,“ServiceMeta”:{},“ServiceName”:“myfancy-api”,“ServicePort”:21338,“ServiceProxyDestination”:“”,“ServiceTags”:[“myfancy-api”,“myfancy”,“api”],“TaggedAddresses”:{“lan”:“192.168.0.67”,“wan”:“192.168.0.67”}}
[Jul 30 16:13:11] DEBUG Namespace: Address
[Jul 30 16:13:11] DEBUG Namespace: ServicePort
[Jul 30 16:13:11] DEBUG Child in list: {“Address”:“192.168.0.68”,“CreateIndex”:9097,“Datacenter”:“localcluster”,“ID”:“7ede99a4-f97d-e84c-47e2-7c7ed1d7e67a”,“ModifyIndex”:9097,“Node”:“analyticsKubeWorker2”,“NodeMeta”:{“consul-network-segment”:“”},“ServiceAddress”:“192.168.0.68”,“ServiceConnect”:{“Native”:false,“Proxy”:null},“ServiceEnableTagOverride”:false,“ServiceID”:“_nomad-task-lhwea4xq4fnh3agknsh6pbycjhhezcjh”,“ServiceKind”:“”,“ServiceMeta”:{},“ServiceName”:“myfancy-api”,“ServicePort”:24602,“ServiceProxyDestination”:“”,“ServiceTags”:[“myfancy-api”,“myfancy”,“api”],“TaggedAddresses”:{“lan”:“192.168.0.68”,“wan”:“192.168.0.68”}}
[Jul 30 16:13:11] DEBUG Namespace: Address
[Jul 30 16:13:11] DEBUG Namespace: ServicePort
[Jul 30 16:13:11] DEBUG Child in list: {“Address”:“192.168.0.68”,“CreateIndex”:9093,“Datacenter”:“localcluster”,“ID”:“7ede99a4-f97d-e84c-47e2-7c7ed1d7e67a”,“ModifyIndex”:9093,“Node”:“analyticsKubeWorker2”,“NodeMeta”:{“consul-network-segment”:“”},“ServiceAddress”:“192.168.0.68”,“ServiceConnect”:{“Native”:false,“Proxy”:null},“ServiceEnableTagOverride”:false,“ServiceID”:“_nomad-task-yzbt45lzot6mgu3b4duic4buv7p2xdqc”,“ServiceKind”:“”,“ServiceMeta”:{},“ServiceName”:“myfancy-api”,“ServicePort”:26273,“ServiceProxyDestination”:“”,“ServiceTags”:[“myfancy-api”,“myfancy”,“api”],“TaggedAddresses”:{“lan”:“192.168.0.68”,“wan”:“192.168.0.68”}}
[Jul 30 16:13:11] DEBUG Namespace: Address
[Jul 30 16:13:11] DEBUG Namespace: ServicePort
[Jul 30 16:13:11] DEBUG Child in list: {“Address”:“192.168.0.68”,“CreateIndex”:9095,“Datacenter”:“localcluster”,“ID”:“7ede99a4-f97d-e84c-47e2-7c7ed1d7e67a”,“ModifyIndex”:9095,“Node”:“analyticsKubeWorker2”,“NodeMeta”:{“consul-network-segment”:“”},“ServiceAddress”:“192.168.0.68”,“ServiceConnect”:{“Native”:false,“Proxy”:null},“ServiceEnableTagOverride”:false,“ServiceID”:“_nomad-task-zeq2gc7sxz2naxrfuo2yecnf6ohhucis”,“ServiceKind”:“”,“ServiceMeta”:{},“ServiceName”:“myfancy-api”,“ServicePort”:26723,“ServiceProxyDestination”:“”,“ServiceTags”:[“myfancy-api”,“myfancy”,“api”],“TaggedAddresses”:{“lan”:“192.168.0.68”,“wan”:“192.168.0.68”}}
[Jul 30 16:13:11] DEBUG Namespace: Address
[Jul 30 16:13:11] DEBUG Namespace: ServicePort
[Jul 30 16:13:11] DEBUG Host list:[192.168.0.67:29371 192.168.0.67:21338 192.168.0.68:24602 192.168.0.68:26273 192.168.0.68:26723]
[Jul 30 16:13:11] DEBUG PROXY: [LOAD BALANCING] Load balancer enabled, getting upstream target
[Jul 30 16:13:11] DEBUG Outbound Request: http://192.168.0.67:29371
[Jul 30 16:13:11] DEBUG Upstream request took (ms): 12.89818
[Jul 30 16:13:11] DEBUG Done proxy
[Jul 30 16:13:11] DEBUG pub-sub: Sending notification{NoticeGatewayDRLNotification {“HostName”:“analyticsAPIGateway”,“ID”:“50b852a9-6045-471c-55c2-9d130c05c633”,“LoadPerSec”:1,“Percentage”:0,“TagHash”:“”} }
[Jul 30 16:13:11] DEBUG Received DRL data: {analyticsAPIGateway 50b852a9-6045-471c-55c2-9d130c05c633 1 0 }
[Jul 30 16:13:11] DEBUG Active Nodes: : 1 [Token Bucket Value]: 100 [Current Load p/s]: 1 [Current Load]: 0.000000
[Jul 30 16:13:12] DEBUG Getting exp for key: analytics-tyk-system-analytics
[Jul 30 16:13:12] DEBUG STORE: Getting WAS: PollerActiveInstanceID
[Jul 30 16:13:12] DEBUG STORE: Getting: host-checker:PollerActiveInstanceID
[Jul 30 16:13:12] DEBUG host-check-mgr: Primary instance set, I am master
[Jul 30 16:13:12] DEBUG STORE: SET Raw key is: PollerActiveInstanceID
[Jul 30 16:13:12] DEBUG STORE: Setting key: host-checker:PollerActiveInstanceID
[Jul 30 16:13:13] DEBUG Getting exp for key: analytics-tyk-system-analytics
[Jul 30 16:13:13] DEBUG pub-sub: Sending notification{NoticeGatewayDRLNotification {“HostName”:“analyticsAPIGateway”,“ID”:“50b852a9-6045-471c-55c2-9d130c05c633”,“LoadPerSec”:1,“Percentage”:0,“TagHash”:“”} }
[Jul 30 16:13:13] DEBUG Received DRL data: {analyticsAPIGateway 50b852a9-6045-471c-55c2-9d130c05c633 1 0 }
[Jul 30 16:13:13] DEBUG Active Nodes: : 1 [Token Bucket Value]: 100 [Current Load p/s]: 1 [Current Load]: 0.000000

Glad to help! :slight_smile:

Thanks
Josh