Bug #91465 | network is ok, but GR node been unreachable | ||
---|---|---|---|
Submitted: | 28 Jun 2018 12:20 | Modified: | 16 Jul 2018 11:28 |
Reporter: | 冯 国强 | Email Updates: | |
Status: | Can't repeat | Impact on me: | |
Category: | MySQL Server: Group Replication | Severity: | S3 (Non-critical) |
Version: | 5.7.20-log | OS: | Linux (Red Hat 4.8.5-16) |
Assigned to: | MySQL Verification Team | CPU Architecture: | x86 |
[28 Jun 2018 12:20]
冯 国强
[28 Jun 2018 12:21]
冯 国强
log
Attachment: report.txt (text/plain), 8.86 KiB.
[16 Jul 2018 11:28]
MySQL Verification Team
Hi, The ping is not highly reliable proof that network is ok since it sends a small and sparse packages... a flood ping with large packets would be more likely but it will load both the port and the network so it's not something you can run "normally non stop", but you can use to test your network. Anyhow, I can't reproduce this problem unless I really introduce issues with network so I'd assume this is not a bug but that your network is somehow corrupted. thanks Bogdan
[5 Nov 2018 12:06]
pavel rekun
same issue. i have a setup of master slave and trying to move to innodb cluster of 3 nodes. so 1 node acting as a slave which synces from the master slave setup. once a huge update tries to execute - 19M rows - the cluster throws: 2018-11-05T10:57:31.746778Z 0 [Warning] Plugin group_replication reported: 'Member with address db02:3306 has become unreachable.' 2018-11-05T10:57:31.753144Z 0 [Warning] Plugin group_replication reported: 'Member with address db03:3306 has become unreachable.' 2018-11-05T10:57:31.753942Z 0 [ERROR] Plugin group_replication reported: 'This server is not able to reach a majority of members in the group. This server will now block all updates. The server will remain blocked until contact with the majority is restored. It is possible to use group_replication_force_members to force a new group membership.' 2018-11-05T10:57:40.567265Z 0 [ERROR] Plugin group_replication reported: 'Member was expelled from the group due to network failures, changing member status to ERROR.' At this point the transaction is reverted - this is happening 100% of the times I try to restart the slave and exceute the huge update. Please note that with a simple Master->Slave setup the huge update passes so my conclusion it's a bug with the group replication plugin.
[5 Nov 2018 13:50]
MySQL Verification Team
I cannot reproduce this with a normal network, only on shady cloud setups where network is problematic. Look at latest 8.0.13 there is group_replication_member_expel_timeout: https://docs.oracle.com/cd/E17952_01/mysql-8.0-en/group-replication-options.html#sysvar_gr... Also check this link for more details https://mysqlhighavailability.com/group-replication-coping-with-unreliable-failure-detecti...
[25 Jun 2019 4:45]
Yoshihide Miyuki
Bogdan Kecman's answer is MySQL 8.0 compliant, is there any MySQL 5.7 compliant?
[25 Jun 2019 7:55]
MySQL Verification Team
Hi, No. Either use the latest 8.x or setup system on a network that works ok. I suggest, strongly, using a setup with proper network quality
[28 Dec 2020 15:02]
MySQL Verification Team
https://bugs.mysql.com/bug.php?id=102075 marked as duplicate of this one.