[GH-ISSUE #2917] 断线失联,gracefully shutdown visitor manager #2324

Closed
opened 2026-05-05 13:30:01 -06:00 by gitea-mirror · 1 comment
Owner

Originally created by @kingsimba on GitHub (Apr 29, 2022).
Original GitHub issue: https://github.com/fatedier/frp/issues/2917

Originally assigned to: @blizard863 on GitHub.

Bug Description

使用过程中,会偶尔出现失联。但是每次都是10多分钟左右就自己恢复了。

  1. 看 frpc 的 log 规律性非常强。
    a. 每次长时间时间失联,都会看到:gracefully shutdown visitor manager,然后10几分钟后,才看login to server success
    b. 而一般情况出现 gracefully shutdown visitor manager,会在1秒内立刻看到 login to server success
  2. frpc 出问题时,客户端机器依然能访问外界其它 websocket 服务。说明网络没问题。

我打算利用log上的规律,做个守护器试试。结果回头再反馈给你。

我的使用场景是:有大量的 frpc(目前有近百台),连接到同一台 frps 上。

frpc Version

0.38.0

frps Version

0.38.0

System Architecture

linux/arm64 树莓派 64 位系统

Configurations

frpc 配置:

[common]
server_addr = xxxx.com
server_port = 7002
token = xxxxxxxxxxxxxxxxxxxxxx
tcp_mux = false

tls_enable = true
tls_cert_file = /opt/iot/etc/frps/server.crt
tls_key_file = /opt/iot/etc/frps/server.key
tls_trusted_ca_file = /opt/iot/etc/frps/ca.crt

[718220110000202-hygeia_1001-ssh]
type = tcp
local_ip = 127.0.0.1
local_port = 22
remote_port = 10129

[718220110000202-hygeia_1001-http]
type = tcp
local_ip = 127.0.0.1
local_port = 8000
remote_port = 10130
[common]
bind_port = 7002
dashboard_port = 7502
dashboard_user = admin
dashboard_pwd = ********
tls_only = true
tls_enable = true
tls_cert_file = /pathto/server.crt
tls_key_file = /pathto/server.key
tls_trusted_ca_file = /pathto/ca.crt
allow_ports = 10001-29999
log_file = /pathto/frps.log
log_level = info
log_max_days = 365
authentication_method = token
token = ******
tcp_mux = false
kcp_bind_port = 7002

Logs

以下提供 log 样本:

失联样本1:16:45:09 出问题,16:58:30 恢复

Apr 29 11:15:38 718220110000202 frpc[615]: 2022/04/29 11:15:38 [I] [service.go:301] [d73ea711b3b667d9] login to server success, get run id [d73ea711b3b667d9],
Apr 29 11:15:38 718220110000202 frpc[615]: 2022/04/29 11:15:38 [I] [proxy_manager.go:144] [d73ea711b3b667d9] proxy added: [718220110000202-hygeia_1001-ssh 7182
Apr 29 11:15:38 718220110000202 frpc[615]: 2022/04/29 11:15:38 [I] [control.go:180] [d73ea711b3b667d9] [718220110000202-hygeia_1001-ssh] start proxy success
Apr 29 11:15:38 718220110000202 frpc[615]: 2022/04/29 11:15:38 [I] [control.go:180] [d73ea711b3b667d9] [718220110000202-hygeia_1001-http] start proxy success
Apr 29 11:16:45 718220110000202 frpc[615]: 2022/04/29 11:16:45 [E] [control.go:158] [d73ea711b3b667d9] work connection closed before response StartWorkConn mes
Apr 29 12:23:41 718220110000202 frpc[615]: 2022/04/29 12:23:41 [E] [proxy.go:796] [d73ea711b3b667d9] [718220110000202-hygeia_1001-http] connect to local servic
Apr 29 12:23:46 718220110000202 frpc[615]: 2022/04/29 12:23:46 [E] [proxy.go:796] [d73ea711b3b667d9] [718220110000202-hygeia_1001-http] connect to local servic
Apr 29 12:23:49 718220110000202 frpc[615]: 2022/04/29 12:23:49 [E] [proxy.go:796] [d73ea711b3b667d9] [718220110000202-hygeia_1001-http] connect to local servic
Apr 29 12:23:54 718220110000202 frpc[615]: 2022/04/29 12:23:54 [E] [proxy.go:796] [d73ea711b3b667d9] [718220110000202-hygeia_1001-http] connect to local servic
Apr 29 12:23:58 718220110000202 frpc[615]: 2022/04/29 12:23:58 [E] [proxy.go:796] [d73ea711b3b667d9] [718220110000202-hygeia_1001-http] connect to local servic
Apr 29 13:25:54 718220110000202 frpc[615]: 2022/04/29 13:25:54 [E] [proxy.go:796] [d73ea711b3b667d9] [718220110000202-hygeia_1001-http] connect to local servic
Apr 29 16:45:09 718220110000202 frpc[615]: 2022/04/29 16:45:09 [W] [control.go:331] [d73ea711b3b667d9] heartbeat timeout
Apr 29 16:45:09 718220110000202 frpc[615]: 2022/04/29 16:45:09 [W] [control.go:268] [d73ea711b3b667d9] read error: read tcp 192.168.225.51:50778->101.201.150.3
Apr 29 16:45:09 718220110000202 frpc[615]: 2022/04/29 16:45:09 [I] [control.go:289] [d73ea711b3b667d9] control writer is closing
Apr 29 16:45:09 718220110000202 frpc[615]: 2022/04/29 16:45:09 [I] [service.go:174] [d73ea711b3b667d9] try to reconnect to server...
Apr 29 16:45:09 718220110000202 frpc[615]: 2022/04/29 16:45:09 [I] [visitor_manager.go:60] [d73ea711b3b667d9] gracefully shutdown visitor manager
Apr 29 16:58:14 718220110000202 frpc[615]: 2022/04/29 16:58:14 [W] [control.go:151] [d73ea711b3b667d9] work connection write to server error: read tcp 192.168.
Apr 29 16:58:30 718220110000202 systemd[1]: Stopping Frp Client Service...
Apr 29 16:58:30 718220110000202 systemd[1]: frpc.service: Main process exited, code=killed, status=15/TERM
Apr 29 16:58:30 718220110000202 systemd[1]: frpc.service: Succeeded.
Apr 29 16:58:30 718220110000202 systemd[1]: Stopped Frp Client Service.
Apr 29 16:58:30 718220110000202 systemd[1]: Started Frp Client Service.
Apr 29 16:58:31 718220110000202 frpc[32736]: 2022/04/29 16:58:31 [I] [service.go:301] [acb48000b32c2a20] login to server success, get run id [acb48000b32c2a20]

失联样本2:15:58:28 失联,之后又打印了两条别的 log,16:15:08恢复

-- Logs begin at Wed 2022-03-30 22:17:01 CST, end at Thu 2022-03-31 16:19:10 CST. --
Mar 30 22:17:09 71822011000240o systemd[1]: Started Frp Client Service.
Mar 30 22:17:10 71822011000240o frpc[598]: 2022/03/30 22:17:10 [I] [service.go:301] [f61bae5c75fa777b] login to server success, get run id [f61bae5c75fa777b], server udp port [0]
Mar 30 22:17:10 71822011000240o frpc[598]: 2022/03/30 22:17:10 [I] [proxy_manager.go:144] [f61bae5c75fa777b] proxy added: [71822011000240o-hygeia_1023-ssh 71822011000240o-hygeia_1023-http]
Mar 30 22:17:10 71822011000240o frpc[598]: 2022/03/30 22:17:10 [I] [control.go:180] [f61bae5c75fa777b] [71822011000240o-hygeia_1023-ssh] start proxy success
Mar 30 22:17:10 71822011000240o frpc[598]: 2022/03/30 22:17:10 [I] [control.go:180] [f61bae5c75fa777b] [71822011000240o-hygeia_1023-http] start proxy success
Mar 31 15:58:28 71822011000240o frpc[598]: 2022/03/31 15:58:28 [W] [control.go:331] [f61bae5c75fa777b] heartbeat timeout
Mar 31 15:58:28 71822011000240o frpc[598]: 2022/03/31 15:58:28 [W] [control.go:268] [f61bae5c75fa777b] read error: read tcp 192.168.225.36:38724->101.201.150.35:7002: use of closed network connection
Mar 31 15:58:28 71822011000240o frpc[598]: 2022/03/31 15:58:28 [I] [control.go:289] [f61bae5c75fa777b] control writer is closing
Mar 31 15:58:28 71822011000240o frpc[598]: 2022/03/31 15:58:28 [I] [service.go:174] [f61bae5c75fa777b] try to reconnect to server...
Mar 31 15:58:28 71822011000240o frpc[598]: 2022/03/31 15:58:28 [I] [visitor_manager.go:60] [f61bae5c75fa777b] gracefully shutdown visitor manager
Mar 31 15:59:32 71822011000240o frpc[598]: 2022/03/31 15:59:32 [E] [control.go:158] [f61bae5c75fa777b] work connection closed before response StartWorkConn message: read tcp 192.168.225.36:44060->101.201.150.35:7002: read: connection timed out
Mar 31 15:59:39 71822011000240o frpc[598]: 2022/03/31 15:59:39 [E] [control.go:158] [f61bae5c75fa777b] work connection closed before response StartWorkConn message: read tcp 192.168.225.36:44094->101.201.150.35:7002: read: connection timed out
Mar 31 16:15:07 71822011000240o frpc[598]: 2022/03/31 16:15:07 [W] [service.go:177] [f61bae5c75fa777b] reconnect to server error: read tcp 192.168.225.36:44166->101.201.150.35:7002: read: connection timed out
Mar 31 16:15:08 71822011000240o frpc[598]: 2022/03/31 16:15:08 [I] [service.go:174] [f61bae5c75fa777b] try to reconnect to server...
Mar 31 16:15:08 71822011000240o frpc[598]: 2022/03/31 16:15:08 [I] [service.go:301] [f61bae5c75fa777b] login to server success, get run id [f61bae5c75fa777b], server udp port [0]
Mar 31 16:15:08 71822011000240o frpc[598]: 2022/03/31 16:15:08 [I] [proxy_manager.go:144] [f61bae5c75fa777b] proxy added: [71822011000240o-hygeia_1023-ssh 71822011000240o-hygeia_1023-http]
Mar 31 16:15:09 71822011000240o frpc[598]: 2022/03/31 16:15:09 [I] [control.go:180] [f61bae5c75fa777b] [71822011000240o-hygeia_1023-ssh] start proxy success
Mar 31 16:15:09 71822011000240o frpc[598]: 2022/03/31 16:15:09 [I] [control.go:180] [f61bae5c75fa777b] [71822011000240o-hygeia_1023-http] start proxy success

失联样本3:15:38:10 失联,15:52:51恢复

Apr 14 15:07:39 718220110000202 frpc[632]: 2022/04/14 15:07:39 [I] [control.go:180] [e375b3cd88674946] [718220110000202-hygeia_1001-ssh] start proxy success
Apr 14 15:07:39 718220110000202 frpc[632]: 2022/04/14 15:07:39 [I] [control.go:180] [e375b3cd88674946] [718220110000202-hygeia_1001-http] start proxy success
Apr 14 15:08:54 718220110000202 frpc[632]: 2022/04/14 15:08:54 [E] [control.go:158] [e375b3cd88674946] work connection closed before response StartWorkConn message: read tcp 192.168.225.29:44320->101.201.150.35:7002
Apr 14 15:08:56 718220110000202 frpc[632]: 2022/04/14 15:08:56 [E] [control.go:158] [e375b3cd88674946] work connection closed before response StartWorkConn message: read tcp 192.168.225.29:47240->101.201.150.35:7002
Apr 14 15:37:03 718220110000202 frpc[632]: 2022/04/14 15:37:03 [W] [control.go:241] [e375b3cd88674946] start new connection to server error: dial tcp 101.201.150.35:7002: connect: connection timed out
Apr 14 15:38:03 718220110000202 frpc[632]: 2022/04/14 15:38:03 [W] [control.go:151] [e375b3cd88674946] work connection write to server error: read tcp 192.168.225.29:48594->101.201.150.35:7002: read: connection time
Apr 14 15:38:10 718220110000202 frpc[632]: 2022/04/14 15:38:10 [W] [control.go:331] [e375b3cd88674946] heartbeat timeout
Apr 14 15:38:10 718220110000202 frpc[632]: 2022/04/14 15:38:10 [W] [control.go:268] [e375b3cd88674946] read error: read tcp 192.168.225.29:47602->101.201.150.35:7002: use of closed network connection
Apr 14 15:38:10 718220110000202 frpc[632]: 2022/04/14 15:38:10 [I] [control.go:289] [e375b3cd88674946] control writer is closing
Apr 14 15:38:10 718220110000202 frpc[632]: 2022/04/14 15:38:10 [I] [service.go:174] [e375b3cd88674946] try to reconnect to server...
Apr 14 15:38:10 718220110000202 frpc[632]: 2022/04/14 15:38:10 [I] [visitor_manager.go:60] [e375b3cd88674946] gracefully shutdown visitor manager
Apr 14 15:51:21 718220110000202 frpc[632]: 2022/04/14 15:51:21 [W] [control.go:151] [e375b3cd88674946] work connection write to server error: read tcp 192.168.225.29:48630->101.201.150.35:7002: read: connection rese
Apr 14 15:51:40 718220110000202 frpc[632]: 2022/04/14 15:51:40 [W] [control.go:151] [e375b3cd88674946] work connection write to server error: read tcp 192.168.225.29:48574->101.201.150.35:7002: read: connection time
Apr 14 15:51:54 718220110000202 frpc[632]: 2022/04/14 15:51:54 [W] [control.go:151] [e375b3cd88674946] work connection write to server error: read tcp 192.168.225.29:48586->101.201.150.35:7002: read: connection time
Apr 14 15:52:00 718220110000202 frpc[632]: 2022/04/14 15:52:00 [W] [control.go:151] [e375b3cd88674946] work connection write to server error: read tcp 192.168.225.29:48590->101.201.150.35:7002: read: connection time
Apr 14 15:52:12 718220110000202 frpc[632]: 2022/04/14 15:52:12 [W] [control.go:151] [e375b3cd88674946] work connection write to server error: read tcp 192.168.225.29:48598->101.201.150.35:7002: read: connection time
Apr 14 15:52:31 718220110000202 frpc[632]: 2022/04/14 15:52:31 [W] [control.go:151] [e375b3cd88674946] work connection write to server error: read tcp 192.168.225.29:48620->101.201.150.35:7002: read: connection time
Apr 14 15:52:49 718220110000202 frpc[632]: 2022/04/14 15:52:49 [W] [service.go:177] [e375b3cd88674946] reconnect to server error: read tcp 192.168.225.29:48632->101.201.150.35:7002: read: connection reset by peer
Apr 14 15:52:50 718220110000202 frpc[632]: 2022/04/14 15:52:50 [I] [service.go:174] [e375b3cd88674946] try to reconnect to server...
Apr 14 15:52:51 718220110000202 frpc[632]: 2022/04/14 15:52:51 [I] [service.go:301] [e375b3cd88674946] login to server success, get run id [e375b3cd88674946], server udp port [0]
Apr 14 15:52:51 718220110000202 frpc[632]: 2022/04/14 15:52:51 [I] [proxy_manager.go:144] [e375b3cd88674946] proxy added: [718220110000202-hygeia_1001-ssh 718220110000202-hygeia_1001-http]
Apr 14 15:52:51 718220110000202 frpc[632]: 2022/04/14 15:52:51 [I] [control.go:180] [e375b3cd88674946] [718220110000202-hygeia_1001-ssh] start proxy success
Apr 14 15:52:51 718220110000202 frpc[632]: 2022/04/14 15:52:51 [I] [control.go:180] [e375b3cd88674946] [718220110000202-hygeia_1001-http] start proxy success

gracefully shutdown 后立刻恢复的样本:

Apr 29 10:55:37 718220110000202 frpc[615]: 2022/04/29 10:55:37 [I] [service.go:301] [d73ea711b3b667d9] login to server success, get run id [d73ea711b3b667d9],
Apr 29 10:55:37 718220110000202 frpc[615]: 2022/04/29 10:55:37 [I] [proxy_manager.go:144] [d73ea711b3b667d9] proxy added: [718220110000202-hygeia_1001-ssh 7182
Apr 29 10:55:37 718220110000202 frpc[615]: 2022/04/29 10:55:37 [I] [control.go:180] [d73ea711b3b667d9] [718220110000202-hygeia_1001-ssh] start proxy success
Apr 29 10:55:37 718220110000202 frpc[615]: 2022/04/29 10:55:37 [I] [control.go:180] [d73ea711b3b667d9] [718220110000202-hygeia_1001-http] start proxy success
Apr 29 10:56:26 718220110000202 frpc[615]: 2022/04/29 10:56:26 [E] [control.go:158] [d73ea711b3b667d9] work connection closed before response StartWorkConn mes
Apr 29 10:56:26 718220110000202 frpc[615]: 2022/04/29 10:56:26 [E] [control.go:158] [d73ea711b3b667d9] work connection closed before response StartWorkConn mes
Apr 29 10:56:32 718220110000202 frpc[615]: 2022/04/29 10:56:32 [E] [control.go:158] [d73ea711b3b667d9] work connection closed before response StartWorkConn mes
Apr 29 10:56:33 718220110000202 frpc[615]: 2022/04/29 10:56:33 [E] [control.go:158] [d73ea711b3b667d9] work connection closed before response StartWorkConn mes
Apr 29 10:56:35 718220110000202 frpc[615]: 2022/04/29 10:56:35 [E] [control.go:158] [d73ea711b3b667d9] work connection closed before response StartWorkConn mes
Apr 29 10:56:39 718220110000202 frpc[615]: 2022/04/29 10:56:39 [E] [control.go:158] [d73ea711b3b667d9] work connection closed before response StartWorkConn mes
Apr 29 11:15:38 718220110000202 frpc[615]: 2022/04/29 11:15:38 [W] [control.go:331] [d73ea711b3b667d9] heartbeat timeout
Apr 29 11:15:38 718220110000202 frpc[615]: 2022/04/29 11:15:38 [W] [control.go:268] [d73ea711b3b667d9] read error: read tcp 192.168.225.51:45960->101.201.150.3
Apr 29 11:15:38 718220110000202 frpc[615]: 2022/04/29 11:15:38 [I] [control.go:289] [d73ea711b3b667d9] control writer is closing
Apr 29 11:15:38 718220110000202 frpc[615]: 2022/04/29 11:15:38 [I] [service.go:174] [d73ea711b3b667d9] try to reconnect to server...
Apr 29 11:15:38 718220110000202 frpc[615]: 2022/04/29 11:15:38 [I] [visitor_manager.go:60] [d73ea711b3b667d9] gracefully shutdown visitor manager
Apr 29 11:15:38 718220110000202 frpc[615]: 2022/04/29 11:15:38 [I] [service.go:301] [d73ea711b3b667d9] login to server success, get run id [d73ea711b3b667d9],
Apr 29 11:15:38 718220110000202 frpc[615]: 2022/04/29 11:15:38 [I] [proxy_manager.go:144] [d73ea711b3b667d9] proxy added: [718220110000202-hygeia_1001-ssh 7182
Apr 29 11:15:38 718220110000202 frpc[615]: 2022/04/29 11:15:38 [I] [control.go:180] [d73ea711b3b667d9] [718220110000202-hygeia_1001-ssh] start proxy success
Apr 29 11:15:38 718220110000202 frpc[615]: 2022/04/29 11:15:38 [I] [control.go:180] [d73ea711b3b667d9] [718220110000202-hygeia_1001-http] start proxy success
Apr 29 11:16:45 718220110000202 frpc[615]: 2022/04/29 11:16:45 [E] [control.go:158] [d73ea711b3b667d9] work connection closed before response StartWorkConn mes
Apr 29 12:23:41 718220110000202 frpc[615]: 2022/04/29 12:23:41 [E] [proxy.go:796] [d73ea711b3b667d9] [718220110000202-hygeia_1001-http] connect to local servic
Apr 29 12:23:46 718220110000202 frpc[615]: 2022/04/29 12:23:46 [E] [proxy.go:796] [d73ea711b3b667d9] [718220110000202-hygeia_1001-http] connect to local servic
Apr 29 12:23:49 718220110000202 frpc[615]: 2022/04/29 12:23:49 [E] [proxy.go:796] [d73ea711b3b667d9] [718220110000202-hygeia_1001-http] connect to local servic
Apr 29 12:23:54 718220110000202 frpc[615]: 2022/04/29 12:23:54 [E] [proxy.go:796] [d73ea711b3b667d9] [718220110000202-hygeia_1001-http] connect to local servic
Apr 29 12:23:58 718220110000202 frpc[615]: 2022/04/29 12:23:58 [E] [proxy.go:796] [d73ea711b3b667d9] [718220110000202-hygeia_1001-http] connect to local servic
Apr 29 13:25:54 718220110000202 frpc[615]: 2022/04/29 13:25:54 [E] [proxy.go:796] [d73ea711b3b667d9] [718220110000202-hygeia_1001-http] connect to local servic

Steps to reproduce

...

Affected area

  • Docs
  • Installation
  • Performance and Scalability
  • Security
  • User Experience
  • Test and Release
  • Developer Infrastructure
  • Client Plugin
  • Server Plugin
  • Extensions
  • Others
Originally created by @kingsimba on GitHub (Apr 29, 2022). Original GitHub issue: https://github.com/fatedier/frp/issues/2917 Originally assigned to: @blizard863 on GitHub. ### Bug Description 使用过程中,会偶尔出现失联。但是每次都是10多分钟左右就自己恢复了。 1. 看 frpc 的 log 规律性非常强。 a. 每次长时间时间失联,都会看到:`gracefully shutdown visitor manager`,然后10几分钟后,才看`login to server success`。 b. 而一般情况出现 `gracefully shutdown visitor manager`,会在1秒内立刻看到 `login to server success`。 2. frpc 出问题时,客户端机器依然能访问外界其它 websocket 服务。说明网络没问题。 我打算利用log上的规律,做个守护器试试。结果回头再反馈给你。 我的使用场景是:有大量的 frpc(目前有近百台),连接到同一台 frps 上。 ### frpc Version 0.38.0 ### frps Version 0.38.0 ### System Architecture linux/arm64 树莓派 64 位系统 ### Configurations frpc 配置: ``` [common] server_addr = xxxx.com server_port = 7002 token = xxxxxxxxxxxxxxxxxxxxxx tcp_mux = false tls_enable = true tls_cert_file = /opt/iot/etc/frps/server.crt tls_key_file = /opt/iot/etc/frps/server.key tls_trusted_ca_file = /opt/iot/etc/frps/ca.crt [718220110000202-hygeia_1001-ssh] type = tcp local_ip = 127.0.0.1 local_port = 22 remote_port = 10129 [718220110000202-hygeia_1001-http] type = tcp local_ip = 127.0.0.1 local_port = 8000 remote_port = 10130 ``` ``` [common] bind_port = 7002 dashboard_port = 7502 dashboard_user = admin dashboard_pwd = ******** tls_only = true tls_enable = true tls_cert_file = /pathto/server.crt tls_key_file = /pathto/server.key tls_trusted_ca_file = /pathto/ca.crt allow_ports = 10001-29999 log_file = /pathto/frps.log log_level = info log_max_days = 365 authentication_method = token token = ****** tcp_mux = false kcp_bind_port = 7002 ``` ### Logs 以下提供 log 样本: 失联样本1:16:45:09 出问题,16:58:30 恢复 ``` Apr 29 11:15:38 718220110000202 frpc[615]: 2022/04/29 11:15:38 [I] [service.go:301] [d73ea711b3b667d9] login to server success, get run id [d73ea711b3b667d9], Apr 29 11:15:38 718220110000202 frpc[615]: 2022/04/29 11:15:38 [I] [proxy_manager.go:144] [d73ea711b3b667d9] proxy added: [718220110000202-hygeia_1001-ssh 7182 Apr 29 11:15:38 718220110000202 frpc[615]: 2022/04/29 11:15:38 [I] [control.go:180] [d73ea711b3b667d9] [718220110000202-hygeia_1001-ssh] start proxy success Apr 29 11:15:38 718220110000202 frpc[615]: 2022/04/29 11:15:38 [I] [control.go:180] [d73ea711b3b667d9] [718220110000202-hygeia_1001-http] start proxy success Apr 29 11:16:45 718220110000202 frpc[615]: 2022/04/29 11:16:45 [E] [control.go:158] [d73ea711b3b667d9] work connection closed before response StartWorkConn mes Apr 29 12:23:41 718220110000202 frpc[615]: 2022/04/29 12:23:41 [E] [proxy.go:796] [d73ea711b3b667d9] [718220110000202-hygeia_1001-http] connect to local servic Apr 29 12:23:46 718220110000202 frpc[615]: 2022/04/29 12:23:46 [E] [proxy.go:796] [d73ea711b3b667d9] [718220110000202-hygeia_1001-http] connect to local servic Apr 29 12:23:49 718220110000202 frpc[615]: 2022/04/29 12:23:49 [E] [proxy.go:796] [d73ea711b3b667d9] [718220110000202-hygeia_1001-http] connect to local servic Apr 29 12:23:54 718220110000202 frpc[615]: 2022/04/29 12:23:54 [E] [proxy.go:796] [d73ea711b3b667d9] [718220110000202-hygeia_1001-http] connect to local servic Apr 29 12:23:58 718220110000202 frpc[615]: 2022/04/29 12:23:58 [E] [proxy.go:796] [d73ea711b3b667d9] [718220110000202-hygeia_1001-http] connect to local servic Apr 29 13:25:54 718220110000202 frpc[615]: 2022/04/29 13:25:54 [E] [proxy.go:796] [d73ea711b3b667d9] [718220110000202-hygeia_1001-http] connect to local servic Apr 29 16:45:09 718220110000202 frpc[615]: 2022/04/29 16:45:09 [W] [control.go:331] [d73ea711b3b667d9] heartbeat timeout Apr 29 16:45:09 718220110000202 frpc[615]: 2022/04/29 16:45:09 [W] [control.go:268] [d73ea711b3b667d9] read error: read tcp 192.168.225.51:50778->101.201.150.3 Apr 29 16:45:09 718220110000202 frpc[615]: 2022/04/29 16:45:09 [I] [control.go:289] [d73ea711b3b667d9] control writer is closing Apr 29 16:45:09 718220110000202 frpc[615]: 2022/04/29 16:45:09 [I] [service.go:174] [d73ea711b3b667d9] try to reconnect to server... Apr 29 16:45:09 718220110000202 frpc[615]: 2022/04/29 16:45:09 [I] [visitor_manager.go:60] [d73ea711b3b667d9] gracefully shutdown visitor manager Apr 29 16:58:14 718220110000202 frpc[615]: 2022/04/29 16:58:14 [W] [control.go:151] [d73ea711b3b667d9] work connection write to server error: read tcp 192.168. Apr 29 16:58:30 718220110000202 systemd[1]: Stopping Frp Client Service... Apr 29 16:58:30 718220110000202 systemd[1]: frpc.service: Main process exited, code=killed, status=15/TERM Apr 29 16:58:30 718220110000202 systemd[1]: frpc.service: Succeeded. Apr 29 16:58:30 718220110000202 systemd[1]: Stopped Frp Client Service. Apr 29 16:58:30 718220110000202 systemd[1]: Started Frp Client Service. Apr 29 16:58:31 718220110000202 frpc[32736]: 2022/04/29 16:58:31 [I] [service.go:301] [acb48000b32c2a20] login to server success, get run id [acb48000b32c2a20] ``` 失联样本2:15:58:28 失联,之后又打印了两条别的 log,16:15:08恢复 ``` -- Logs begin at Wed 2022-03-30 22:17:01 CST, end at Thu 2022-03-31 16:19:10 CST. -- Mar 30 22:17:09 71822011000240o systemd[1]: Started Frp Client Service. Mar 30 22:17:10 71822011000240o frpc[598]: 2022/03/30 22:17:10 [I] [service.go:301] [f61bae5c75fa777b] login to server success, get run id [f61bae5c75fa777b], server udp port [0] Mar 30 22:17:10 71822011000240o frpc[598]: 2022/03/30 22:17:10 [I] [proxy_manager.go:144] [f61bae5c75fa777b] proxy added: [71822011000240o-hygeia_1023-ssh 71822011000240o-hygeia_1023-http] Mar 30 22:17:10 71822011000240o frpc[598]: 2022/03/30 22:17:10 [I] [control.go:180] [f61bae5c75fa777b] [71822011000240o-hygeia_1023-ssh] start proxy success Mar 30 22:17:10 71822011000240o frpc[598]: 2022/03/30 22:17:10 [I] [control.go:180] [f61bae5c75fa777b] [71822011000240o-hygeia_1023-http] start proxy success Mar 31 15:58:28 71822011000240o frpc[598]: 2022/03/31 15:58:28 [W] [control.go:331] [f61bae5c75fa777b] heartbeat timeout Mar 31 15:58:28 71822011000240o frpc[598]: 2022/03/31 15:58:28 [W] [control.go:268] [f61bae5c75fa777b] read error: read tcp 192.168.225.36:38724->101.201.150.35:7002: use of closed network connection Mar 31 15:58:28 71822011000240o frpc[598]: 2022/03/31 15:58:28 [I] [control.go:289] [f61bae5c75fa777b] control writer is closing Mar 31 15:58:28 71822011000240o frpc[598]: 2022/03/31 15:58:28 [I] [service.go:174] [f61bae5c75fa777b] try to reconnect to server... Mar 31 15:58:28 71822011000240o frpc[598]: 2022/03/31 15:58:28 [I] [visitor_manager.go:60] [f61bae5c75fa777b] gracefully shutdown visitor manager Mar 31 15:59:32 71822011000240o frpc[598]: 2022/03/31 15:59:32 [E] [control.go:158] [f61bae5c75fa777b] work connection closed before response StartWorkConn message: read tcp 192.168.225.36:44060->101.201.150.35:7002: read: connection timed out Mar 31 15:59:39 71822011000240o frpc[598]: 2022/03/31 15:59:39 [E] [control.go:158] [f61bae5c75fa777b] work connection closed before response StartWorkConn message: read tcp 192.168.225.36:44094->101.201.150.35:7002: read: connection timed out Mar 31 16:15:07 71822011000240o frpc[598]: 2022/03/31 16:15:07 [W] [service.go:177] [f61bae5c75fa777b] reconnect to server error: read tcp 192.168.225.36:44166->101.201.150.35:7002: read: connection timed out Mar 31 16:15:08 71822011000240o frpc[598]: 2022/03/31 16:15:08 [I] [service.go:174] [f61bae5c75fa777b] try to reconnect to server... Mar 31 16:15:08 71822011000240o frpc[598]: 2022/03/31 16:15:08 [I] [service.go:301] [f61bae5c75fa777b] login to server success, get run id [f61bae5c75fa777b], server udp port [0] Mar 31 16:15:08 71822011000240o frpc[598]: 2022/03/31 16:15:08 [I] [proxy_manager.go:144] [f61bae5c75fa777b] proxy added: [71822011000240o-hygeia_1023-ssh 71822011000240o-hygeia_1023-http] Mar 31 16:15:09 71822011000240o frpc[598]: 2022/03/31 16:15:09 [I] [control.go:180] [f61bae5c75fa777b] [71822011000240o-hygeia_1023-ssh] start proxy success Mar 31 16:15:09 71822011000240o frpc[598]: 2022/03/31 16:15:09 [I] [control.go:180] [f61bae5c75fa777b] [71822011000240o-hygeia_1023-http] start proxy success ``` 失联样本3:15:38:10 失联,15:52:51恢复 ``` Apr 14 15:07:39 718220110000202 frpc[632]: 2022/04/14 15:07:39 [I] [control.go:180] [e375b3cd88674946] [718220110000202-hygeia_1001-ssh] start proxy success Apr 14 15:07:39 718220110000202 frpc[632]: 2022/04/14 15:07:39 [I] [control.go:180] [e375b3cd88674946] [718220110000202-hygeia_1001-http] start proxy success Apr 14 15:08:54 718220110000202 frpc[632]: 2022/04/14 15:08:54 [E] [control.go:158] [e375b3cd88674946] work connection closed before response StartWorkConn message: read tcp 192.168.225.29:44320->101.201.150.35:7002 Apr 14 15:08:56 718220110000202 frpc[632]: 2022/04/14 15:08:56 [E] [control.go:158] [e375b3cd88674946] work connection closed before response StartWorkConn message: read tcp 192.168.225.29:47240->101.201.150.35:7002 Apr 14 15:37:03 718220110000202 frpc[632]: 2022/04/14 15:37:03 [W] [control.go:241] [e375b3cd88674946] start new connection to server error: dial tcp 101.201.150.35:7002: connect: connection timed out Apr 14 15:38:03 718220110000202 frpc[632]: 2022/04/14 15:38:03 [W] [control.go:151] [e375b3cd88674946] work connection write to server error: read tcp 192.168.225.29:48594->101.201.150.35:7002: read: connection time Apr 14 15:38:10 718220110000202 frpc[632]: 2022/04/14 15:38:10 [W] [control.go:331] [e375b3cd88674946] heartbeat timeout Apr 14 15:38:10 718220110000202 frpc[632]: 2022/04/14 15:38:10 [W] [control.go:268] [e375b3cd88674946] read error: read tcp 192.168.225.29:47602->101.201.150.35:7002: use of closed network connection Apr 14 15:38:10 718220110000202 frpc[632]: 2022/04/14 15:38:10 [I] [control.go:289] [e375b3cd88674946] control writer is closing Apr 14 15:38:10 718220110000202 frpc[632]: 2022/04/14 15:38:10 [I] [service.go:174] [e375b3cd88674946] try to reconnect to server... Apr 14 15:38:10 718220110000202 frpc[632]: 2022/04/14 15:38:10 [I] [visitor_manager.go:60] [e375b3cd88674946] gracefully shutdown visitor manager Apr 14 15:51:21 718220110000202 frpc[632]: 2022/04/14 15:51:21 [W] [control.go:151] [e375b3cd88674946] work connection write to server error: read tcp 192.168.225.29:48630->101.201.150.35:7002: read: connection rese Apr 14 15:51:40 718220110000202 frpc[632]: 2022/04/14 15:51:40 [W] [control.go:151] [e375b3cd88674946] work connection write to server error: read tcp 192.168.225.29:48574->101.201.150.35:7002: read: connection time Apr 14 15:51:54 718220110000202 frpc[632]: 2022/04/14 15:51:54 [W] [control.go:151] [e375b3cd88674946] work connection write to server error: read tcp 192.168.225.29:48586->101.201.150.35:7002: read: connection time Apr 14 15:52:00 718220110000202 frpc[632]: 2022/04/14 15:52:00 [W] [control.go:151] [e375b3cd88674946] work connection write to server error: read tcp 192.168.225.29:48590->101.201.150.35:7002: read: connection time Apr 14 15:52:12 718220110000202 frpc[632]: 2022/04/14 15:52:12 [W] [control.go:151] [e375b3cd88674946] work connection write to server error: read tcp 192.168.225.29:48598->101.201.150.35:7002: read: connection time Apr 14 15:52:31 718220110000202 frpc[632]: 2022/04/14 15:52:31 [W] [control.go:151] [e375b3cd88674946] work connection write to server error: read tcp 192.168.225.29:48620->101.201.150.35:7002: read: connection time Apr 14 15:52:49 718220110000202 frpc[632]: 2022/04/14 15:52:49 [W] [service.go:177] [e375b3cd88674946] reconnect to server error: read tcp 192.168.225.29:48632->101.201.150.35:7002: read: connection reset by peer Apr 14 15:52:50 718220110000202 frpc[632]: 2022/04/14 15:52:50 [I] [service.go:174] [e375b3cd88674946] try to reconnect to server... Apr 14 15:52:51 718220110000202 frpc[632]: 2022/04/14 15:52:51 [I] [service.go:301] [e375b3cd88674946] login to server success, get run id [e375b3cd88674946], server udp port [0] Apr 14 15:52:51 718220110000202 frpc[632]: 2022/04/14 15:52:51 [I] [proxy_manager.go:144] [e375b3cd88674946] proxy added: [718220110000202-hygeia_1001-ssh 718220110000202-hygeia_1001-http] Apr 14 15:52:51 718220110000202 frpc[632]: 2022/04/14 15:52:51 [I] [control.go:180] [e375b3cd88674946] [718220110000202-hygeia_1001-ssh] start proxy success Apr 14 15:52:51 718220110000202 frpc[632]: 2022/04/14 15:52:51 [I] [control.go:180] [e375b3cd88674946] [718220110000202-hygeia_1001-http] start proxy success ``` gracefully shutdown 后立刻恢复的样本: ``` Apr 29 10:55:37 718220110000202 frpc[615]: 2022/04/29 10:55:37 [I] [service.go:301] [d73ea711b3b667d9] login to server success, get run id [d73ea711b3b667d9], Apr 29 10:55:37 718220110000202 frpc[615]: 2022/04/29 10:55:37 [I] [proxy_manager.go:144] [d73ea711b3b667d9] proxy added: [718220110000202-hygeia_1001-ssh 7182 Apr 29 10:55:37 718220110000202 frpc[615]: 2022/04/29 10:55:37 [I] [control.go:180] [d73ea711b3b667d9] [718220110000202-hygeia_1001-ssh] start proxy success Apr 29 10:55:37 718220110000202 frpc[615]: 2022/04/29 10:55:37 [I] [control.go:180] [d73ea711b3b667d9] [718220110000202-hygeia_1001-http] start proxy success Apr 29 10:56:26 718220110000202 frpc[615]: 2022/04/29 10:56:26 [E] [control.go:158] [d73ea711b3b667d9] work connection closed before response StartWorkConn mes Apr 29 10:56:26 718220110000202 frpc[615]: 2022/04/29 10:56:26 [E] [control.go:158] [d73ea711b3b667d9] work connection closed before response StartWorkConn mes Apr 29 10:56:32 718220110000202 frpc[615]: 2022/04/29 10:56:32 [E] [control.go:158] [d73ea711b3b667d9] work connection closed before response StartWorkConn mes Apr 29 10:56:33 718220110000202 frpc[615]: 2022/04/29 10:56:33 [E] [control.go:158] [d73ea711b3b667d9] work connection closed before response StartWorkConn mes Apr 29 10:56:35 718220110000202 frpc[615]: 2022/04/29 10:56:35 [E] [control.go:158] [d73ea711b3b667d9] work connection closed before response StartWorkConn mes Apr 29 10:56:39 718220110000202 frpc[615]: 2022/04/29 10:56:39 [E] [control.go:158] [d73ea711b3b667d9] work connection closed before response StartWorkConn mes Apr 29 11:15:38 718220110000202 frpc[615]: 2022/04/29 11:15:38 [W] [control.go:331] [d73ea711b3b667d9] heartbeat timeout Apr 29 11:15:38 718220110000202 frpc[615]: 2022/04/29 11:15:38 [W] [control.go:268] [d73ea711b3b667d9] read error: read tcp 192.168.225.51:45960->101.201.150.3 Apr 29 11:15:38 718220110000202 frpc[615]: 2022/04/29 11:15:38 [I] [control.go:289] [d73ea711b3b667d9] control writer is closing Apr 29 11:15:38 718220110000202 frpc[615]: 2022/04/29 11:15:38 [I] [service.go:174] [d73ea711b3b667d9] try to reconnect to server... Apr 29 11:15:38 718220110000202 frpc[615]: 2022/04/29 11:15:38 [I] [visitor_manager.go:60] [d73ea711b3b667d9] gracefully shutdown visitor manager Apr 29 11:15:38 718220110000202 frpc[615]: 2022/04/29 11:15:38 [I] [service.go:301] [d73ea711b3b667d9] login to server success, get run id [d73ea711b3b667d9], Apr 29 11:15:38 718220110000202 frpc[615]: 2022/04/29 11:15:38 [I] [proxy_manager.go:144] [d73ea711b3b667d9] proxy added: [718220110000202-hygeia_1001-ssh 7182 Apr 29 11:15:38 718220110000202 frpc[615]: 2022/04/29 11:15:38 [I] [control.go:180] [d73ea711b3b667d9] [718220110000202-hygeia_1001-ssh] start proxy success Apr 29 11:15:38 718220110000202 frpc[615]: 2022/04/29 11:15:38 [I] [control.go:180] [d73ea711b3b667d9] [718220110000202-hygeia_1001-http] start proxy success Apr 29 11:16:45 718220110000202 frpc[615]: 2022/04/29 11:16:45 [E] [control.go:158] [d73ea711b3b667d9] work connection closed before response StartWorkConn mes Apr 29 12:23:41 718220110000202 frpc[615]: 2022/04/29 12:23:41 [E] [proxy.go:796] [d73ea711b3b667d9] [718220110000202-hygeia_1001-http] connect to local servic Apr 29 12:23:46 718220110000202 frpc[615]: 2022/04/29 12:23:46 [E] [proxy.go:796] [d73ea711b3b667d9] [718220110000202-hygeia_1001-http] connect to local servic Apr 29 12:23:49 718220110000202 frpc[615]: 2022/04/29 12:23:49 [E] [proxy.go:796] [d73ea711b3b667d9] [718220110000202-hygeia_1001-http] connect to local servic Apr 29 12:23:54 718220110000202 frpc[615]: 2022/04/29 12:23:54 [E] [proxy.go:796] [d73ea711b3b667d9] [718220110000202-hygeia_1001-http] connect to local servic Apr 29 12:23:58 718220110000202 frpc[615]: 2022/04/29 12:23:58 [E] [proxy.go:796] [d73ea711b3b667d9] [718220110000202-hygeia_1001-http] connect to local servic Apr 29 13:25:54 718220110000202 frpc[615]: 2022/04/29 13:25:54 [E] [proxy.go:796] [d73ea711b3b667d9] [718220110000202-hygeia_1001-http] connect to local servic ``` ### Steps to reproduce 1. 2. 3. ... ### Affected area - [ ] Docs - [ ] Installation - [ ] Performance and Scalability - [ ] Security - [ ] User Experience - [ ] Test and Release - [ ] Developer Infrastructure - [ ] Client Plugin - [ ] Server Plugin - [ ] Extensions - [ ] Others
gitea-mirror 2026-05-05 13:30:01 -06:00
Author
Owner

@github-actions[bot] commented on GitHub (May 31, 2022):

Issues go stale after 30d of inactivity. Stale issues rot after an additional 7d of inactivity and eventually close.

<!-- gh-comment-id:1141558886 --> @github-actions[bot] commented on GitHub (May 31, 2022): Issues go stale after 30d of inactivity. Stale issues rot after an additional 7d of inactivity and eventually close.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: github-starred/frp#2324
No description provided.