Downlik Failure of Server

Hi all,

we can run all the components of the server in a container without any problem. Since one month, they run perfectly and have not been updated. Yesterday, we saw that the server schedules no downlink anymore. Then, we transmitted downlink via a POST request from the application to the app-server and got back a 401 Unauthorized as well as a “stream error”.
A restart of the application did not work, but a restart of the app-server itself.

The versions used of the LoRaserver and Appserver are

LoRaserver: 2.8.2
Appserver: 2.6.1

Does anyone have an idea what the problem is and what caused it? Maybe a token that expires? An overloaded database?

The logs can be seen here:

{“log”:“time=“2019-08-07T16:12:02Z” level=info msg=“integration/mqtt: publishing message” qos=0 topic=application/53/device/3a6ce7c7030ffb3c/rx\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:02.488690788Z”}
{“log”:“time=“2019-08-07T16:12:02Z” level=info msg=“integration/http: publishing data-up payload” dev_eui=3a6ce7c7030ffb3c url=”[INTEGRATION_URL]"\n",“stream”:“stderr”,“time”:“2019-08-07T16:12:02.489405582Z”}
{“log”:“time=“2019-08-07T16:12:03Z” level=error msg=“integration/multi: integration *http.Integration error” error=“send error: http request error: Post [INTEGRATION_URL]: stream error: stream ID 6039753; REFUSED_STREAM”\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:03.062995836Z”}
{“log”:“time=“2019-08-07T16:12:03Z” level=info msg=“device updated” dev_eui=c5ab894a3b6c9e57\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:03.177517327Z”}
{“log”:“time=“2019-08-07T16:12:03Z” level=info msg=“finished unary call with code OK” grpc.code=OK grpc.method=HandleUplinkData grpc.request.deadline=“2019-08-07T16:12:04Z” grpc.service=as.ApplicationServerService grpc.start_time=“2019-08-07T16:12:03Z” grpc.time_ms=7.037 peer.address=“172.18.30.7:50070” span.kind=server system=grpc\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:03.183437868Z”}
{“log”:“time=“2019-08-07T16:12:03Z” level=info msg=“integration/mqtt: publishing message” qos=0 topic=application/53/device/c5ab894a3b6c9e57/rx\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:03.183687556Z”}
{“log”:“time=“2019-08-07T16:12:03Z” level=info msg=“integration/http: publishing data-up payload” dev_eui=c5ab894a3b6c9e57 url=”[INTEGRATION_URL]"\n",“stream”:“stderr”,“time”:“2019-08-07T16:12:03.184445803Z”}
{“log”:“time=“2019-08-07T16:12:03Z” level=error msg=“integration/multi: integration *http.Integration error” error=“send error: http request error: Post [INTEGRATION_URL]: stream error: stream ID 6039769; REFUSED_STREAM”\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:03.349587801Z”}
{“log”:“time=“2019-08-07T16:12:03Z” level=error msg=“integration/multi: integration *http.Integration error” error=“send error: http request error: Post [INTEGRATION_URL]: stream error: stream ID 6039773; REFUSED_STREAM”\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:03.46277626Z”}
{“log”:“time=“2019-08-07T16:12:03Z” level=error msg=“integration/multi: integration *http.Integration error” error=“send error: http request error: Post [INTEGRATION_URL]: stream error: stream ID 6039781; REFUSED_STREAM”\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:03.930025874Z”}
{“log”:“time=“2019-08-07T16:12:04Z” level=error msg=“integration/multi: integration *http.Integration error” error=“send error: http request error: Post [INTEGRATION_URL]: stream error: stream ID 6039785; REFUSED_STREAM”\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:04.113091592Z”}
{“log”:“time=“2019-08-07T16:12:04Z” level=error msg=“integration/multi: integration *http.Integration error” error=“send error: http request error: Post [INTEGRATION_URL]: stream error: stream ID 6039789; REFUSED_STREAM”\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:04.189864108Z”}
{“log”:“time=“2019-08-07T16:12:04Z” level=error msg=“integration/multi: integration *http.Integration error” error=“send error: http request error: Post [INTEGRATION_URL]: stream error: stream ID 6039797; REFUSED_STREAM”\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:04.438216308Z”}
{“log”:“time=“2019-08-07T16:12:04Z” level=error msg=“integration/multi: integration *http.Integration error” error=“send error: http request error: Post [INTEGRATION_URL]: stream error: stream ID 6039801; REFUSED_STREAM”\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:04.54042466Z”}
{“log”:“time=“2019-08-07T16:12:06Z” level=info msg=“device updated” dev_eui=1bfe992a2972cc7b\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:06.134612633Z”}
{“log”:“time=“2019-08-07T16:12:06Z” level=info msg=“finished unary call with code OK” grpc.code=OK grpc.method=HandleUplinkData grpc.request.deadline=“2019-08-07T16:12:07Z” grpc.service=as.ApplicationServerService grpc.start_time=“2019-08-07T16:12:06Z” grpc.time_ms=7.388 peer.address=“172.18.30.7:50070” span.kind=server system=grpc\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:06.140551043Z”}
{“log”:“time=“2019-08-07T16:12:06Z” level=info msg=“integration/mqtt: publishing message” qos=0 topic=application/53/device/1bfe992a2972cc7b/rx\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:06.140832707Z”}
{“log”:“time=“2019-08-07T16:12:06Z” level=info msg=“integration/http: publishing data-up payload” dev_eui=1bfe992a2972cc7b url=”[INTEGRATION_URL]"\n",“stream”:“stderr”,“time”:“2019-08-07T16:12:06.142169409Z”}
{“log”:“time=“2019-08-07T16:12:07Z” level=error msg=“integration/multi: integration *http.Integration error” error=“send error: http request error: Post [INTEGRATION_URL]: stream error: stream ID 6039851; REFUSED_STREAM”\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:07.080762084Z”}
{“log”:“time=“2019-08-07T16:12:07Z” level=error msg=“integration/multi: integration *http.Integration error” error=“send error: http request error: Post [INTEGRATION_URL]: stream error: stream ID 6039863; REFUSED_STREAM”\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:07.44704528Z”}
{“log”:“time=“2019-08-07T16:12:07Z” level=info msg=“device updated” dev_eui=842ee8731cf084c6\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:07.794225299Z”}
{“log”:“time=“2019-08-07T16:12:07Z” level=info msg=“finished unary call with code OK” grpc.code=OK grpc.method=HandleUplinkData grpc.request.deadline=“2019-08-07T16:12:08Z” grpc.service=as.ApplicationServerService grpc.start_time=“2019-08-07T16:12:07Z” grpc.time_ms=6.974 peer.address=“172.18.30.7:50070” span.kind=server system=grpc\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:07.799910053Z”}
{“log”:“time=“2019-08-07T16:12:07Z” level=info msg=“integration/mqtt: publishing message” qos=0 topic=application/53/device/842ee8731cf084c6/rx\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:07.800163714Z”}
{“log”:“time=“2019-08-07T16:12:07Z” level=info msg=“integration/http: publishing data-up payload” dev_eui=842ee8731cf084c6 url=”[INTEGRATION_URL]"\n",“stream”:“stderr”,“time”:“2019-08-07T16:12:07.800885322Z”}
{“log”:“time=“2019-08-07T16:12:07Z” level=error msg=“integration/multi: integration *http.Integration error” error=“send error: http request error: Post [INTEGRATION_URL]: stream error: stream ID 6039875; REFUSED_STREAM”\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:07.955171423Z”}
{“log”:“time=“2019-08-07T16:12:08Z” level=error msg=“integration/multi: integration *http.Integration error” error=“send error: http request error: Post [INTEGRATION_URL]: stream error: stream ID 6039877; REFUSED_STREAM”\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:08.138103163Z”}
{“log”:“time=“2019-08-07T16:12:08Z” level=error msg=“integration/multi: integration *http.Integration error” error=“send error: http request error: Post [INTEGRATION_URL]: stream error: stream ID 6039885; REFUSED_STREAM”\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:08.300600467Z”}
{“log”:“time=“2019-08-07T16:12:08Z” level=info msg=“device updated” dev_eui=c8c6573f7d0e7f86\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:08.328171276Z”}
{“log”:“time=“2019-08-07T16:12:08Z” level=info msg=“finished unary call with code OK” grpc.code=OK grpc.method=HandleUplinkData grpc.request.deadline=“2019-08-07T16:12:09Z” grpc.service=as.ApplicationServerService grpc.start_time=“2019-08-07T16:12:08Z” grpc.time_ms=10.357 peer.address=“172.18.30.7:50070” span.kind=server system=grpc\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:08.337099492Z”}
{“log”:“time=“2019-08-07T16:12:08Z” level=info msg=“integration/mqtt: publishing message” qos=0 topic=application/53/device/c8c6573f7d0e7f86/rx\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:08.337402614Z”}
{“log”:“time=“2019-08-07T16:12:08Z” level=info msg=“integration/http: publishing data-up payload” dev_eui=c8c6573f7d0e7f86 url=”[INTEGRATION_URL]"\n",“stream”:“stderr”,“time”:“2019-08-07T16:12:08.338147674Z”}
{“log”:“time=“2019-08-07T16:12:08Z” level=info msg=“device updated” dev_eui=7af4d7cdc3c81f95\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:08.403992943Z”}
{“log”:“time=“2019-08-07T16:12:08Z” level=info msg=“finished unary call with code OK” grpc.code=OK grpc.method=HandleUplinkData grpc.request.deadline=“2019-08-07T16:12:09Z” grpc.service=as.ApplicationServerService grpc.start_time=“2019-08-07T16:12:08Z” grpc.time_ms=8.654 peer.address=“172.18.30.7:50070” span.kind=server system=grpc\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:08.409871858Z”}
{“log”:“time=“2019-08-07T16:12:08Z” level=info msg=“integration/mqtt: publishing message” qos=0 topic=application/53/device/7af4d7cdc3c81f95/rx\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:08.410122213Z”}
{“log”:“time=“2019-08-07T16:12:08Z” level=info msg=“integration/http: publishing data-up payload” dev_eui=7af4d7cdc3c81f95 url=”[INTEGRATION_URL]"\n",“stream”:“stderr”,“time”:“2019-08-07T16:12:08.410893689Z”}
{“log”:“time=“2019-08-07T16:12:08Z” level=error msg=“integration/multi: integration *http.Integration error” error=“send error: http request error: Post [INTEGRATION_URL]: stream error: stream ID 6039897; REFUSED_STREAM”\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:08.440820826Z”}
{“log”:“time=“2019-08-07T16:12:08Z” level=info msg=“device updated” dev_eui=ea2c3a28360453f5\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:08.468653813Z”}
{“log”:“time=“2019-08-07T16:12:08Z” level=info msg=“finished unary call with code OK” grpc.code=OK grpc.method=HandleUplinkData grpc.request.deadline=“2019-08-07T16:12:09Z” grpc.service=as.ApplicationServerService grpc.start_time=“2019-08-07T16:12:08Z” grpc.time_ms=7.854 peer.address=“172.18.30.7:50070” span.kind=server system=grpc\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:08.474971963Z”}
{“log”:“time=“2019-08-07T16:12:08Z” level=info msg=“integration/mqtt: publishing message” qos=0 topic=application/53/device/ea2c3a28360453f5/rx\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:08.475262163Z”}
{“log”:“time=“2019-08-07T16:12:08Z” level=info msg=“integration/http: publishing data-up payload” dev_eui=ea2c3a28360453f5 url=”[INTEGRATION_URL]"\n",“stream”:“stderr”,“time”:“2019-08-07T16:12:08.476030346Z”}
{“log”:“time=“2019-08-07T16:12:08Z” level=info msg=“device updated” dev_eui=a2b29ea0fb7922c2\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:08.541545625Z”}
{“log”:“time=“2019-08-07T16:12:08Z” level=info msg=“finished unary call with code OK” grpc.code=OK grpc.method=HandleUplinkData grpc.request.deadline=“2019-08-07T16:12:09Z” grpc.service=as.ApplicationServerService grpc.start_time=“2019-08-07T16:12:08Z” grpc.time_ms=6.969 peer.address=“172.18.30.7:50070” span.kind=server system=grpc\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:08.54735278Z”}
{“log”:“time=“2019-08-07T16:12:08Z” level=info msg=“integration/mqtt: publishing message” qos=0 topic=application/53/device/a2b29ea0fb7922c2/rx\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:08.547605554Z”}
{“log”:“time=“2019-08-07T16:12:08Z” level=info msg=“integration/http: publishing data-up payload” dev_eui=a2b29ea0fb7922c2 url=”[INTEGRATION_URL]"\n",“stream”:“stderr”,“time”:“2019-08-07T16:12:08.548369426Z”}
{“log”:“time=“2019-08-07T16:12:08Z” level=info msg=“device updated” dev_eui=ee3910033b2a7799\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:08.573167674Z”}
{“log”:“time=“2019-08-07T16:12:08Z” level=info msg=“finished unary call with code OK” grpc.code=OK grpc.method=HandleUplinkData grpc.request.deadline=“2019-08-07T16:12:09Z” grpc.service=as.ApplicationServerService grpc.start_time=“2019-08-07T16:12:08Z” grpc.time_ms=6.104 peer.address=“172.18.30.7:50070” span.kind=server system=grpc\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:08.578123044Z”}
{“log”:“time=“2019-08-07T16:12:08Z” level=info msg=“integration/mqtt: publishing message” qos=0 topic=application/53/device/ee3910033b2a7799/rx\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:08.57843653Z”}
{“log”:“time=“2019-08-07T16:12:08Z” level=info msg=“integration/http: publishing data-up payload” dev_eui=ee3910033b2a7799 url=”[INTEGRATION_URL]"\n",“stream”:“stderr”,“time”:“2019-08-07T16:12:08.579216325Z”}
{“log”:“time=“2019-08-07T16:12:09Z” level=error msg=“integration/multi: integration *http.Integration error” error=“send error: http request error: Post [INTEGRATION_URL]: stream error: stream ID 6039931; REFUSED_STREAM”\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:09.258293362Z”}
{“log”:“time=“2019-08-07T16:12:09Z” level=error msg=“integration/multi: integration *http.Integration error” error=“send error: http request error: Post [INTEGRATION_URL]: stream error: stream ID 6039939; REFUSED_STREAM”\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:09.457527734Z”}
{“log”:“time=“2019-08-07T16:12:09Z” level=error msg=“integration/multi: integration *http.Integration error” error=“send error: http request error: Post [INTEGRATION_URL]: stream error: stream ID 6039945; REFUSED_STREAM”\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:09.508259654Z”}
{“log”:“time=“2019-08-07T16:12:09Z” level=error msg=“integration/multi: integration *http.Integration error” error=“send error: http request error: Post [INTEGRATION_URL]: stream error: stream ID 6039955; REFUSED_STREAM”\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:09.623875842Z”}
{“log”:“time=“2019-08-07T16:12:09Z” level=error msg=“integration/multi: integration *http.Integration error” error=“send error: http request error: Post [INTEGRATION_URL]: stream error: stream ID 6039957; REFUSED_STREAM”\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:09.996301736Z”}
{“log”:“time=“2019-08-07T16:12:10Z” level=error msg=“integration/multi: integration *http.Integration error” error=“send error: http request error: Post [INTEGRATION_URL]: stream error: stream ID 6039973; REFUSED_STREAM”\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:10.741017045Z”}
{“log”:“time=“2019-08-07T16:12:11Z” level=info msg=“device updated” dev_eui=f7d73f9efc423fa6\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:11.358187549Z”}
{“log”:“time=“2019-08-07T16:12:11Z” level=info msg=“finished unary call with code OK” grpc.code=OK grpc.method=HandleUplinkData grpc.request.deadline=“2019-08-07T16:12:12Z” grpc.service=as.ApplicationServerService grpc.start_time=“2019-08-07T16:12:11Z” grpc.time_ms=7.25 peer.address=“172.18.30.7:50070” span.kind=server system=grpc\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:11.364204959Z”}
{“log”:“time=“2019-08-07T16:12:11Z” level=info msg=“integration/mqtt: publishing message” qos=0 topic=application/53/device/f7d73f9efc423fa6/rx\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:11.364498402Z”}
{“log”:“time=“2019-08-07T16:12:11Z” level=info msg=“integration/http: publishing data-up payload” dev_eui=f7d73f9efc423fa6 url=”[INTEGRATION_URL]"\n",“stream”:“stderr”,“time”:“2019-08-07T16:12:11.365306283Z”}
{“log”:“time=“2019-08-07T16:12:11Z” level=info msg=“device updated” dev_eui=e4a388d814a7e9af\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:11.589382613Z”}
{“log”:“time=“2019-08-07T16:12:11Z” level=info msg=“finished unary call with code OK” grpc.code=OK grpc.method=HandleUplinkData grpc.request.deadline=“2019-08-07T16:12:12Z” grpc.service=as.ApplicationServerService grpc.start_time=“2019-08-07T16:12:11Z” grpc.time_ms=9.131 peer.address=“172.18.30.7:50070” span.kind=server system=grpc\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:11.597504744Z”}
{“log”:“time=“2019-08-07T16:12:11Z” level=info msg=“integration/mqtt: publishing message” qos=0 topic=application/53/device/e4a388d814a7e9af/rx\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:11.598095408Z”}
{“log”:“time=“2019-08-07T16:12:11Z” level=info msg=“integration/http: publishing data-up payload” dev_eui=e4a388d814a7e9af url=”[INTEGRATION_URL]"\n",“stream”:“stderr”,“time”:“2019-08-07T16:12:11.599667623Z”}
{“log”:“time=“2019-08-07T16:12:11Z” level=info msg=“device updated” dev_eui=e1e5d5782337d028\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:11.860391224Z”}
{“log”:“time=“2019-08-07T16:12:11Z” level=info msg=“finished unary call with code OK” grpc.code=OK grpc.method=HandleUplinkData grpc.request.deadline=“2019-08-07T16:12:12Z” grpc.service=as.ApplicationServerService grpc.start_time=“2019-08-07T16:12:11Z” grpc.time_ms=7.517 peer.address=“172.18.30.7:50070” span.kind=server system=grpc\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:11.866485319Z”}
{“log”:“time=“2019-08-07T16:12:11Z” level=info msg=“integration/mqtt: publishing message” qos=0 topic=application/53/device/e1e5d5782337d028/rx\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:11.86673661Z”}
{“log”:“time=“2019-08-07T16:12:11Z” level=info msg=“integration/http: publishing data-up payload” dev_eui=e1e5d5782337d028 url=”[INTEGRATION_URL]"\n",“stream”:“stderr”,“time”:“2019-08-07T16:12:11.867536261Z”}
{“log”:“time=“2019-08-07T16:12:12Z” level=info msg=“device updated” dev_eui=074519fc851edfe6\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:12.180294133Z”}
{“log”:“time=“2019-08-07T16:12:12Z” level=info msg=“finished unary call with code OK” grpc.code=OK grpc.method=HandleUplinkData grpc.request.deadline=“2019-08-07T16:12:13Z” grpc.service=as.ApplicationServerService grpc.start_time=“2019-08-07T16:12:12Z” grpc.time_ms=7.003 peer.address=“172.18.30.7:50070” span.kind=server system=grpc\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:12.185832568Z”}
{“log”:“time=“2019-08-07T16:12:12Z” level=info msg=“integration/mqtt: publishing message” qos=0 topic=application/53/device/074519fc851edfe6/rx\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:12.186064755Z”}
{“log”:“time=“2019-08-07T16:12:12Z” level=info msg=“integration/http: publishing data-up payload” dev_eui=074519fc851edfe6 url=”[INTEGRATION_URL]"\n",“stream”:“stderr”,“time”:“2019-08-07T16:12:12.1868217Z”}
{“log”:“time=“2019-08-07T16:12:12Z” level=error msg=“integration/multi: integration *http.Integration error” error=“send error: http request error: Post [INTEGRATION_URL]: stream error: stream ID 6040011; REFUSED_STREAM”\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:12.36668943Z”}
{“log”:“time=“2019-08-07T16:12:12Z” level=error msg=“integration/multi: integration *http.Integration error” error=“send error: http request error: Post [INTEGRATION_URL]: stream error: stream ID 6040015; REFUSED_STREAM”\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:12.447931859Z”}
{“log”:“time=“2019-08-07T16:12:12Z” level=error msg=“integration/multi: integration *http.Integration error” error=“send error: http request error: Post [INTEGRATION_URL]: stream error: stream ID 6040019; REFUSED_STREAM”\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:12.644186535Z”}
{“log”:“time=“2019-08-07T16:12:12Z” level=info msg=“device updated” dev_eui=fc9e5425bf8bbd59\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:12.939039451Z”}
{“log”:“time=“2019-08-07T16:12:12Z” level=info msg=“finished unary call with code OK” grpc.code=OK grpc.method=HandleUplinkData grpc.request.deadline=“2019-08-07T16:12:13Z” grpc.service=as.ApplicationServerService grpc.start_time=“2019-08-07T16:12:12Z” grpc.time_ms=8.045 peer.address=“172.18.30.7:50070” span.kind=server system=grpc\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:12.945649895Z”}
{“log”:“time=“2019-08-07T16:12:12Z” level=info msg=“integration/mqtt: publishing message” qos=0 topic=application/53/device/fc9e5425bf8bbd59/rx\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:12.945898243Z”}
{“log”:“time=“2019-08-07T16:12:12Z” level=info msg=“integration/http: publishing data-up payload” dev_eui=fc9e5425bf8bbd59 url=”[INTEGRATION_URL]"\n",“stream”:“stderr”,“time”:“2019-08-07T16:12:12.946623405Z”}
{“log”:“time=“2019-08-07T16:12:13Z” level=info msg=“device updated” dev_eui=60947c73d97769e2\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:13.104335851Z”}
{“log”:“time=“2019-08-07T16:12:13Z” level=info msg=“finished unary call with code OK” grpc.code=OK grpc.method=HandleUplinkData grpc.request.deadline=“2019-08-07T16:12:14Z” grpc.service=as.ApplicationServerService grpc.start_time=“2019-08-07T16:12:13Z” grpc.time_ms=19.174 peer.address=“172.18.30.7:50070” span.kind=server system=grpc\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:13.121251556Z”}
{“log”:“time=“2019-08-07T16:12:13Z” level=info msg=“integration/mqtt: publishing message” qos=0 topic=application/53/device/60947c73d97769e2/rx\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:13.122875226Z”}
{“log”:“time=“2019-08-07T16:12:13Z” level=info msg=“integration/http: publishing data-up payload” dev_eui=60947c73d97769e2 url=”[INTEGRATION_URL]"\n",“stream”:“stderr”,“time”:“2019-08-07T16:12:13.123687843Z”}
{“log”:“time=“2019-08-07T16:12:13Z” level=info msg=“device updated” dev_eui=7e15350c3c08a76c\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:13.132130863Z”}
{“log”:“time=“2019-08-07T16:12:13Z” level=info msg=“finished unary call with code OK” grpc.code=OK grpc.method=HandleUplinkData grpc.request.deadline=“2019-08-07T16:12:14Z” grpc.service=as.ApplicationServerService grpc.start_time=“2019-08-07T16:12:13Z” grpc.time_ms=7.057 peer.address=“172.18.30.7:50070” span.kind=server system=grpc\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:13.138092299Z”}
{“log”:“time=“2019-08-07T16:12:13Z” level=info msg=“integration/mqtt: publishing message” qos=0 topic=application/53/device/7e15350c3c08a76c/rx\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:13.138347831Z”}
{“log”:“time=“2019-08-07T16:12:13Z” level=info msg=“integration/http: publishing data-up payload” dev_eui=7e15350c3c08a76c url=”[INTEGRATION_URL]"\n",“stream”:“stderr”,“time”:“2019-08-07T16:12:13.139044482Z”}
{“log”:“time=“2019-08-07T16:12:13Z” level=error msg=“integration/multi: integration *http.Integration error” error=“send error: http request error: Post [INTEGRATION_URL]: stream error: stream ID 6040049; REFUSED_STREAM”\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:13.402611246Z”}
{“log”:“time=“2019-08-07T16:12:13Z” level=error msg=“integration/multi: integration *http.Integration error” error=“send error: http request error: Post [INTEGRATION_URL]: stream error: stream ID 6040057; REFUSED_STREAM”\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:13.999036195Z”}
{“log”:“time=“2019-08-07T16:12:14Z” level=error msg=“integration/multi: integration *http.Integration error” error=“send error: http request error: Post [INTEGRATION_URL]: stream error: stream ID 6040063; REFUSED_STREAM”\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:14.35730085Z”}
{“log”:“time=“2019-08-07T16:12:14Z” level=error msg=“integration/multi: integration *http.Integration error” error=“send error: http request error: Post [INTEGRATION_URL]: stream error: stream ID 6040067; REFUSED_STREAM”\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:14.592430905Z”}
{“log”:“time=“2019-08-07T16:12:15Z” level=error msg=“integration/multi: integration *http.Integration error” error=“send error: http request error: Post [INTEGRATION_URL]: stream error: stream ID 6040079; REFUSED_STREAM”\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:15.002312791Z”}
{“log”:“time=“2019-08-07T16:12:15Z” level=error msg=“integration/multi: integration *http.Integration error” error=“send error: http request error: Post [INTEGRATION_URL]: stream error: stream ID 6040083; REFUSED_STREAM”\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:15.048856712Z”}
{“log”:“time=“2019-08-07T16:12:15Z” level=info msg=“device updated” dev_eui=1c1c78323d7ee99e\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:15.894794673Z”}
{“log”:“time=“2019-08-07T16:12:15Z” level=info msg=“finished unary call with code OK” grpc.code=OK grpc.method=HandleUplinkData grpc.request.deadline=“2019-08-07T16:12:16Z” grpc.service=as.ApplicationServerService grpc.start_time=“2019-08-07T16:12:15Z” grpc.time_ms=8.402 peer.address=“172.18.30.7:50070” span.kind=server system=grpc\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:15.900592938Z”}
{“log”:“time=“2019-08-07T16:12:15Z” level=info msg=“integration/mqtt: publishing message” qos=0 topic=application/53/device/1c1c78323d7ee99e/rx\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:15.900842733Z”}
{“log”:“time=“2019-08-07T16:12:15Z” level=info msg=“integration/http: publishing data-up payload” dev_eui=1c1c78323d7ee99e url=”[INTEGRATION_URL]"\n",“stream”:“stderr”,“time”:“2019-08-07T16:12:15.901600926Z”}
{“log”:“time=“2019-08-07T16:12:15Z” level=info msg=“finished unary call with code Unauthenticated” error=“rpc error: code = Unauthenticated desc = authentication failed: get token from context error: no authorization-data in metadata” grpc.code=Unauthenticated grpc.method=Enqueue grpc.service=api.DeviceQueueService grpc.start_time=“2019-08-07T16:12:15Z” grpc.time_ms=0.033 peer.address=“127.0.0.1:37942” span.kind=server system=grpc\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:15.944914899Z”}
{“log”:“time=“2019-08-07T16:12:16Z” level=info msg=“device updated” dev_eui=5060bee5bfa1b19f\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:16.034513382Z”}
{“log”:“time=“2019-08-07T16:12:16Z” level=error msg=“integration/multi: integration *http.Integration error” error=“send error: http request error: Post [INTEGRATION_URL]: stream error: stream ID 6040113; REFUSED_STREAM”\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:16.053451084Z”}
{“log”:“time=“2019-08-07T16:12:16Z” level=info msg=“device updated” dev_eui=30db8701e97c747e\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:16.155617549Z”}
{“log”:“time=“2019-08-07T16:12:16Z” level=info msg=“finished unary call with code OK” grpc.code=OK grpc.method=Login grpc.service=api.InternalService grpc.start_time=“2019-08-07T16:12:15Z” grpc.time_ms=229.292 peer.address=“127.0.0.1:37948” span.kind=server system=grpc\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:16.190251322Z”}
{“log”:“time=“2019-08-07T16:12:16Z” level=error msg=“decode payload error” application_id=53 codec=CUSTOM_JS dev_eui=5060bee5bfa1b19f error=“execution timeout” f_cnt=0 f_port=183\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:16.190697025Z”}
{“log”:“time=“2019-08-07T16:12:16Z” level=info msg=“finished unary call with code OK” grpc.code=OK grpc.method=HandleUplinkData grpc.request.deadline=“2019-08-07T16:12:17Z” grpc.service=as.ApplicationServerService grpc.start_time=“2019-08-07T16:12:16Z” grpc.time_ms=158.12 peer.address=“172.18.30.7:50070” span.kind=server system=grpc\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:16.191442461Z”}
{“log”:“time=“2019-08-07T16:12:16Z” level=info msg=“integration/mqtt: publishing message” qos=0 topic=application/53/device/5060bee5bfa1b19f/error\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:16.191654076Z”}
{“log”:“time=“2019-08-07T16:12:16Z” level=info msg=“integration/mqtt: publishing message” qos=0 topic=application/53/device/5060bee5bfa1b19f/rx\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:16.192317901Z”}
{“log”:“time=“2019-08-07T16:12:16Z” level=info msg=“integration/http: publishing data-up payload” dev_eui=5060bee5bfa1b19f url=”[INTEGRATION_URL]"\n",“stream”:“stderr”,“time”:“2019-08-07T16:12:16.192872462Z”}
{“log”:“time=“2019-08-07T16:12:16Z” level=info msg=“finished unary call with code OK” grpc.code=OK grpc.method=HandleUplinkData grpc.request.deadline=“2019-08-07T16:12:17Z” grpc.service=as.ApplicationServerService grpc.start_time=“2019-08-07T16:12:16Z” grpc.time_ms=40.329 peer.address=“172.18.30.7:50070” span.kind=server system=grpc\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:16.194900584Z”}
{“log”:“time=“2019-08-07T16:12:16Z” level=info msg=“integration/mqtt: publishing message” qos=0 topic=application/53/device/30db8701e97c747e/rx\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:16.195108456Z”}
{“log”:“time=“2019-08-07T16:12:16Z” level=info msg=“integration/http: publishing data-up payload” dev_eui=30db8701e97c747e url=”[INTEGRATION_URL]"\n",“stream”:“stderr”,“time”:“2019-08-07T16:12:16.195687473Z”}
{“log”:“time=“2019-08-07T16:12:16Z” level=warning msg=“Deprecated Authorization header : RFC1945 format expected : Authorization: \u003ctype\u003e \u003ccredentials\u003e”\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:16.205246379Z”}
{“log”:“time=“2019-08-07T16:12:16Z” level=info msg=“finished unary call with code Unauthenticated” error=“rpc error: code = Unauthenticated desc = authentication failed: not authorized” grpc.code=Unauthenticated grpc.method=Enqueue grpc.service=api.DeviceQueueService grpc.start_time=“2019-08-07T16:12:16Z” grpc.time_ms=36.877 peer.address=“127.0.0.1:37942” span.kind=server system=grpc\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:16.242204753Z”}
{“log”:“time=“2019-08-07T16:12:16Z” level=info msg=“device updated” dev_eui=e0c247eac2299cd4\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:16.270094917Z”}
{“log”:“time=“2019-08-07T16:12:16Z” level=error msg=“decode payload error” application_id=53 codec=CUSTOM_JS dev_eui=e0c247eac2299cd4 error=“execution timeout” f_cnt=0 f_port=183\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:16.425231969Z”}
{“log”:“time=“2019-08-07T16:12:16Z” level=info msg=“finished unary call with code OK” grpc.code=OK grpc.method=HandleUplinkData grpc.request.deadline=“2019-08-07T16:12:17Z” grpc.service=as.ApplicationServerService grpc.start_time=“2019-08-07T16:12:16Z” grpc.time_ms=157.375 peer.address=“172.18.30.7:50070” span.kind=server system=grpc\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:16.426414762Z”}
{“log”:“time=“2019-08-07T16:12:16Z” level=info msg=“integration/mqtt: publishing message” qos=0 topic=application/53/device/e0c247eac2299cd4/error\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:16.445450747Z”}
{“log”:“time=“2019-08-07T16:12:16Z” level=info msg=“integration/mqtt: publishing message” qos=0 topic=application/53/device/e0c247eac2299cd4/rx\n”,“stream”:“stderr”,“time”:“2019-08-07T16:12:16.446746658Z”}
{“log”:“time=“2019-08-07T16:12:16Z” level=info msg=“integration/http: publishing data-up payload” dev_eui=e0c247eac2299cd4 url=”[INTEGRATION_URL]"\n",“stream”:“stderr”,“time”:“2019-08-07T16:12:16.447538403Z”}

Thank you very much!

Best regards
DeHi

Hi again,

I see that before the errors occur, the following error is printed and apprently comes from the Go http2 package

{“log”:“time=“2019-08-30T00:18:21Z” level=error msg=“integration/multi: integration *http.Integration error” error=“send error: http request error: Post [INTEGRATION_URL]: http2: stream closed”\n”,“stream”:“stderr”,“time”:“2019-08-30T00:18:21.490654811Z”}

Can someone tell me why the stream is closed or what caused it?

BR / DeHi