服务运行一段时间后,服务接口异常,无法返回数据

Blade 未结 1 134
捷睿
捷睿 剑圣 2022-05-17 17:43

一、该问题的重现步骤是什么?

  1.  blade-data-transfer服务运行一段时间后(几天),GET: /blade-data-transfer/datatransferlog/page 接口异常,无法返回数据,Nacos显示正常

Failed to handle request [GET http://11.11.152.52/blade-data-transfer/datatransferlog/page?current=1&size=10]: finishConnect(..) failed: Connection refused: /11.11.152.52:8389


image.png


二、你期待的结果是什么?实际看到的又是什么?


三、你正在使用的是什么产品,什么版本?在什么操作系统上?

2.7.1 

CentOS 7


四、请提供详细的错误堆栈信息,这很重要。

{"log":"2022-05-17 16:57:54.745  INFO 1 --- [r-http-epoll-14] o.s.g.filter.GlobalRequestLogFilter      : \n","stream":"stdout","time":"2022-05-17T08:57:54.746398456Z"}

{"log":"\n","stream":"stdout","time":"2022-05-17T08:57:54.746538691Z"}

{"log":"================ Gateway Request Start  ================\n","stream":"stdout","time":"2022-05-17T08:57:54.746562011Z"}

{"log":"===\u003e GET: /blade-data-transfer/datatransferlog/page?current=1\u0026size=10\n","stream":"stdout","time":"2022-05-17T08:57:54.746576482Z"}

{"log":"===Headers===  Host: [11.11.152.52]\n","stream":"stdout","time":"2022-05-17T08:57:54.746591993Z"}

{"log":"===Headers===  X-Real-IP: [10.201.2.241]\n","stream":"stdout","time":"2022-05-17T08:57:54.746605707Z"}

{"log":"===Headers===  X-Forwarded-For: [10.201.2.241]\n","stream":"stdout","time":"2022-05-17T08:57:54.74669156Z"}

{"log":"===Headers===  Connection: [close]\n","stream":"stdout","time":"2022-05-17T08:57:54.746791816Z"}

{"log":"===Headers===  Pragma: [no-cache]\n","stream":"stdout","time":"2022-05-17T08:57:54.746930815Z"}

{"log":"===Headers===  Cache-Control: [no-cache]\n","stream":"stdout","time":"2022-05-17T08:57:54.747044396Z"}

{"log":"===Headers===  Accept: [application/json, text/plain, */*]\n","stream":"stdout","time":"2022-05-17T08:57:54.747092533Z"}

{"log":"===Headers===  Authorization: [Basic c2FiZXI6c2FiZXJfc2VjcmV0]\n","stream":"stdout","time":"2022-05-17T08:57:54.747138356Z"}

{"log":"===Headers===  Blade-Auth: [bearer eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJ0ZW5hbnRfaWQiOiIwMDAwMDAiLCJ1c2VyX25hbWUiOiJhZG1pbiIsInJlYWxfbmFtZSI6IueuoeeQhuWRmCIsImF2YXRhciI6Imh0dHBzOi8vZ3cuYWxpcGF5b2JqZWN0cy5jb20vem9zL3Jtc3BvcnRhbC9CaWF6ZmFueG1hbU5Sb3h4VnhrYS5wbmciLCJhdXRob3JpdGllcyI6WyJhZG1pbmlzdHJhdG9yIl0sImNsaWVudF9pZCI6InNhYmVyIiwicm9sZV9uYW1lIjoiYWRtaW5pc3RyYXRvciIsImxpY2Vuc2UiOiJwb3dlcmVkIGJ5IGJsYWRleCIsInBvc3RfaWQiOiIxMTIzNTk4ODE3NzM4Njc1MjAxIiwidXNlcl9pZCI6IjExMjM1OTg4MjE3Mzg2NzUyMDEiLCJyb2xlX2lkIjoiMTEyMzU5ODgxNjczODY3NTIwMSIsInNjb3BlIjpbImFsbCJdLCJuaWNrX25hbWUiOiLnrqHnkIblkZgiLCJvYXV0aF9pZCI6IiIsImRldGFpbCI6eyJ0eXBlIjoid2ViIn0sImV4cCI6MTY1Mjc4MTQ1MSwiZGVwdF9pZCI6IjEwMDAwMDAwMDAwMDA2MDc4NjEiLCJqdGkiOiJkZDYyMmE4OS02MmNiLTRkMDQtYmM0My0yMGYyNWQyYjg4MjkiLCJhY2NvdW50IjoiYWRtaW4ifQ.fOMTXBbXUOEUcnsHtO6225k1dUrZlrA7zXs6YgC41A0]\n","stream":"stdout","time":"2022-05-17T08:57:54.747251493Z"}

{"log":"===Headers===  User-Agent: [Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/101.0.4951.64 Safari/537.36 Edg/101.0.1210.47]\n","stream":"stdout","time":"2022-05-17T08:57:54.747319291Z"}

{"log":"===Headers===  Referer: [http://11.11.152.52:8000/]\n","stream":"stdout","time":"2022-05-17T08:57:54.747362979Z"}

{"log":"===Headers===  Accept-Encoding: [gzip, deflate]\n","stream":"stdout","time":"2022-05-17T08:57:54.747379362Z"}

{"log":"===Headers===  Accept-Language: [zh-CN,zh;q=0.9,en;q=0.8,en-GB;q=0.7,en-US;q=0.6]\n","stream":"stdout","time":"2022-05-17T08:57:54.747406892Z"}

{"log":"===Headers===  Cookie: [XXL_JOB_LOGIN_IDENTITY=7b226964223a312c22757365726e616d65223a2261646d696e222c2270617373776f7264223a223231323332663239376135376135613734333839346130653461383031666333222c22726f6c65223a312c227065726d697373696f6e223a6e756c6c7d; _jap_sso_id=eyJhbGciOiJIUzUxMiJ9.eyJqdGkiOiIxMTIzNTk4ODIxNzM4Njc1MjAxIiwiaXAiOiIxMC4yMDEuMi4yNDEiLCJpc3MiOiJhZG1pbiIsInVhIjoiOGQzYTgiLCJpYXQiOjE2NTI3NTExOTJ9.oo6lFlBjPIxDfN4gxnyl2AVtFK4xtYo0tjS0vhekOFKGiRBvhIn3hW7xNw8xX_oMeRBisfV2UY63x7uK2aIqsw; JSESSIONID=DuQZ86sZQdkM1aIGF2mqKjUZlx0_dkWC2oia1Sfn; _jap_remember_me=YWRtaW46MTY1Mjc1Mzc4NDk1NzowMTI5YWVhZTlkMzE2MDQz; saber-access-token=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJ0ZW5hbnRfaWQiOiIwMDAwMDAiLCJ1c2VyX25hbWUiOiJhZG1pbiIsInJlYWxfbmFtZSI6IueuoeeQhuWRmCIsImF2YXRhciI6Imh0dHBzOi8vZ3cuYWxpcGF5b2JqZWN0cy5jb20vem9zL3Jtc3BvcnRhbC9CaWF6ZmFueG1hbU5Sb3h4VnhrYS5wbmciLCJhdXRob3JpdGllcyI6WyJhZG1pbmlzdHJhdG9yIl0sImNsaWVudF9pZCI6InNhYmVyIiwicm9sZV9uYW1lIjoiYWRtaW5pc3RyYXRvciIsImxpY2Vuc2UiOiJwb3dlcmVkIGJ5IGJsYWRleCIsInBvc3RfaWQiOiIxMTIzNTk4ODE3NzM4Njc1MjAxIiwidXNlcl9pZCI6IjExMjM1OTg4MjE3Mzg2NzUyMDEiLCJyb2xlX2lkIjoiMTEyMzU5ODgxNjczODY3NTIwMSIsInNjb3BlIjpbImFsbCJdLCJuaWNrX25hbWUiOiLnrqHnkIblkZgiLCJvYXV0aF9pZCI6IiIsImRldGFpbCI6eyJ0eXBlIjoid2ViIn0sImV4cCI6MTY1Mjc4MTQ1MSwiZGVwdF9pZCI6IjEwMDAwMDAwMDAwMDA2MDc4NjEiLCJqdGkiOiJkZDYyMmE4OS02MmNiLTRkMDQtYmM0My0yMGYyNWQyYjg4MjkiLCJhY2NvdW50IjoiYWRtaW4ifQ.fOMTXBbXUOEUcnsHtO6225k1dUrZlrA7zXs6YgC41A0; saber-refresh-token=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJ0ZW5hbnRfaWQiOiIwMDAwMDAiLCJ1c2VyX25hbWUiOiJhZG1pbiIsInJlYWxfbmFtZSI6IueuoeeQhuWRmCIsImF2YXRhciI6Imh0dHBzOi8vZ3cuYWxpcGF5b2JqZWN0cy5jb20vem9zL3Jtc3BvcnRhbC9CaWF6ZmFueG1hbU5Sb3h4VnhrYS5wbmciLCJhdXRob3JpdGllcyI6WyJhZG1pbmlzdHJhdG9yIl0sImNsaWVudF9pZCI6InNhYmVyIiwicm9sZV9uYW1lIjoiYWRtaW5pc3RyYXRvciIsImxpY2Vuc2UiOiJwb3dlcmVkIGJ5IGJsYWRleCIsInBvc3RfaWQiOiIxMTIzNTk4ODE3NzM4Njc1MjAxIiwidXNlcl9pZCI6IjExMjM1OTg4MjE3Mzg2NzUyMDEiLCJyb2xlX2lkIjoiMTEyMzU5ODgxNjczODY3NTIwMSIsInNjb3BlIjpbImFsbCJdLCJuaWNrX25hbWUiOiLnrqHnkIblkZgiLCJhdGkiOiJkZDYyMmE4OS02MmNiLTRkMDQtYmM0My0yMGYyNWQyYjg4MjkiLCJvYXV0aF9pZCI6IiIsImRldGFpbCI6eyJ0eXBlIjoid2ViIn0sImV4cCI6MTY1MzM1NTk5MiwiZGVwdF9pZCI6IjEwMDAwMDAwMDAwMDA2MDc4NjEiLCJqdGkiOiIxMzhlMGE5OC1mYTRjLTRmZjQtYjRiNi1hM2M4YmJiY2U0NzciLCJhY2NvdW50IjoiYWRtaW4ifQ.rckJtuV74pejHXElH7wuCOuZHnppEeYtNY5F0xecN7A]\n","stream":"stdout","time":"2022-05-17T08:57:54.747539402Z"}

{"log":"================  Gateway Request End  =================\n","stream":"stdout","time":"2022-05-17T08:57:54.747606771Z"}

{"log":"\n","stream":"stdout","time":"2022-05-17T08:57:54.747628046Z"}

{"log":"2022-05-17 16:57:54.752 ERROR 1 --- [r-http-epoll-14] a.w.r.e.AbstractErrorWebExceptionHandler : [4aa53568-1478068]  500 Server Error for HTTP GET \"/blade-data-transfer/datatransferlog/page?current=1\u0026size=10\"\n","stream":"stdout","time":"2022-05-17T08:57:54.753279793Z"}

{"log":"\n","stream":"stdout","time":"2022-05-17T08:57:54.753363468Z"}

{"log":"io.netty.channel.AbstractChannel$AnnotatedConnectException: finishConnect(..) failed: Connection refused: /11.11.152.52:8389\n","stream":"stdout","time":"2022-05-17T08:57:54.753388248Z"}

{"log":"\u0009Suppressed: reactor.core.publisher.FluxOnAssembly$OnAssemblyException: \n","stream":"stdout","time":"2022-05-17T08:57:54.753421455Z"}

{"log":"Error has been observed at the following site(s):\n","stream":"stdout","time":"2022-05-17T08:57:54.75356939Z"}

{"log":"\u0009|_ checkpoint ⇢ org.springblade.gateway.config.RouterFunctionConfiguration$$Lambda$415/1262607708 [DefaultWebFilterChain]\n","stream":"stdout","time":"2022-05-17T08:57:54.753605613Z"}

{"log":"\u0009|_ checkpoint ⇢ org.springframework.cloud.gateway.filter.WeightCalculatorWebFilter [DefaultWebFilterChain]\n","stream":"stdout","time":"2022-05-17T08:57:54.753626985Z"}

{"log":"\u0009|_ checkpoint ⇢ org.springframework.boot.actuate.metrics.web.reactive.server.MetricsWebFilter [DefaultWebFilterChain]\n","stream":"stdout","time":"2022-05-17T08:57:54.753671693Z"}

{"log":"\u0009|_ checkpoint ⇢ HTTP GET \"/blade-data-transfer/datatransferlog/page?current=1\u0026size=10\" [ExceptionHandlingWebHandler]\n","stream":"stdout","time":"2022-05-17T08:57:54.753810973Z"}

{"log":"Stack trace:\n","stream":"stdout","time":"2022-05-17T08:57:54.753833591Z"}

{"log":"Caused by: java.net.ConnectException: finishConnect(..) failed: Connection refused\n","stream":"stdout","time":"2022-05-17T08:57:54.753847421Z"}

{"log":"\u0009at io.netty.channel.unix.Errors.throwConnectException(Errors.java:124) ~[netty-transport-native-unix-common-4.1.55.Final.jar!/:4.1.55.Final]\n","stream":"stdout","time":"2022-05-17T08:57:54.753894648Z"}

{"log":"\u0009at io.netty.channel.unix.Socket.finishConnect(Socket.java:251) ~[netty-transport-native-unix-common-4.1.55.Final.jar!/:4.1.55.Final]\n","stream":"stdout","time":"2022-05-17T08:57:54.753986099Z"}

{"log":"\u0009at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.doFinishConnect(AbstractEpollChannel.java:673) [netty-transport-native-epoll-4.1.55.Final-linux-x86_64.jar!/:4.1.55.Final]\n","stream":"stdout","time":"2022-05-17T08:57:54.754069323Z"}

{"log":"\u0009at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:650) [netty-transport-native-epoll-4.1.55.Final-linux-x86_64.jar!/:4.1.55.Final]\n","stream":"stdout","time":"2022-05-17T08:57:54.754120377Z"}

{"log":"\u0009at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:530) [netty-transport-native-epoll-4.1.55.Final-linux-x86_64.jar!/:4.1.55.Final]\n","stream":"stdout","time":"2022-05-17T08:57:54.754198272Z"}

{"log":"\u0009at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:470) ~[netty-transport-native-epoll-4.1.55.Final-linux-x86_64.jar!/:4.1.55.Final]\n","stream":"stdout","time":"2022-05-17T08:57:54.754219229Z"}

{"log":"\u0009at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) ~[netty-transport-native-epoll-4.1.55.Final-linux-x86_64.jar!/:4.1.55.Final]\n","stream":"stdout","time":"2022-05-17T08:57:54.754265637Z"}

{"log":"\u0009at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[netty-common-4.1.55.Final.jar!/:4.1.55.Final]\n","stream":"stdout","time":"2022-05-17T08:57:54.75435916Z"}

{"log":"\u0009at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[netty-common-4.1.55.Final.jar!/:4.1.55.Final]\n","stream":"stdout","time":"2022-05-17T08:57:54.754443788Z"}

{"log":"\u0009at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ~[netty-common-4.1.55.Final.jar!/:4.1.55.Final]\n","stream":"stdout","time":"2022-05-17T08:57:54.754550917Z"}

{"log":"\u0009at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_202]\n","stream":"stdout","time":"2022-05-17T08:57:54.754572112Z"}

{"log":"\n","stream":"stdout","time":"2022-05-17T08:57:54.754610745Z"}



五、若有更多详细信息,请在下面提供。

1条回答
  • 2022-05-17 20:10

    看着启动的服务非常多,你看一下服务器的cpu和内存占比是多少。

    提示Connection refused的时候,你访问对应服务+ip,看看返回的是什么,这样访问是否能正常返回。

    如果能正常返回数据,则说明服务没有问题,如果不能返回则说明服务进程关闭了。

    如果正常返回但是通过Gateway访问不正常,则说明nacos注册出问题。这些需要去排查一边才可以查询问题所在。

    0 讨论(0)
提交回复