Bug #100687 rpl_nogtid.rpl_gtid_mode is unstable
Submitted: 29 Aug 2020 1:46 Modified: 31 Aug 2020 8:54
Reporter: zhijun long Email Updates:
Status: Verified Impact on me:
None 
Category:Tests: Replication Severity:S7 (Test Cases)
Version:8.0.21 OS:Any
Assigned to: CPU Architecture:Any

[29 Aug 2020 1:46] zhijun long
Description:
Hi all

The mtr case rpl_nogtid.rpl_gtid_mode fails during concurrent execution.

[lzj@ecs]$ ./mtr rpl_nogtid.rpl_gtid_mode{,,} --parallel=8 --repeat=10
Logging: ../mysql-8.0.21/mysql-test/mysql-test-run.pl  rpl_nogtid.rpl_gtid_mode rpl_nogtid.rpl_gtid_mode rpl_nogtid.rpl_gtid_mode --parallel=8 --repeat=10
MySQL Version 8.0.21
Checking supported features
 - Binaries are debug compiled
Using 'all' suites
Collecting tests
 - Adding combinations for rpl_nogtid
Checking leftover processes
Removing old var directory
Creating var directory '../mysql-8.0.21/cmake_build/mysql-test/var'
Installing system database
Using parallel: 8

==============================================================================
                  TEST NAME                   WORKER RESULT  TIME (ms) COMMENT
------------------------------------------------------------------------------
[  1%] rpl_nogtid.rpl_gtid_mode 'mix'           w2  [ pass ]  86448
[  2%] rpl_nogtid.rpl_gtid_mode 'mix'           w5  [ pass ]  89815
[  3%] rpl_nogtid.rpl_gtid_mode 'mix'           w6  [ pass ]  81800
[  4%] rpl_nogtid.rpl_gtid_mode 'mix'           w1  [ pass ]  83309
[  5%] rpl_nogtid.rpl_gtid_mode 'mix'           w7  [ pass ]  83815
[  6%] rpl_nogtid.rpl_gtid_mode 'mix'           w3  [ pass ]  84764
[  7%] rpl_nogtid.rpl_gtid_mode 'mix'           w4  [ pass ]  84647
[  8%] rpl_nogtid.rpl_gtid_mode 'mix'           w8  [ pass ]  85306
[  9%] rpl_nogtid.rpl_gtid_mode 'mix'           w2  [ pass ]  66366
[ 10%] rpl_nogtid.rpl_gtid_mode 'row'           w6  [ pass ]  62704
[ 12%] rpl_nogtid.rpl_gtid_mode 'mix'           w5  [ pass ]  64683
[ 13%] rpl_nogtid.rpl_gtid_mode 'row'           w3  [ pass ]  60026
[ 14%] rpl_nogtid.rpl_gtid_mode 'row'           w1  [ pass ]  62264
[ 15%] rpl_nogtid.rpl_gtid_mode 'row'           w7  [ pass ]  61026
[ 16%] rpl_nogtid.rpl_gtid_mode 'stmt'          w4  [ pass ]  61264
[ 17%] rpl_nogtid.rpl_gtid_mode 'stmt'          w8  [ pass ]  62543
[ 18%] rpl_nogtid.rpl_gtid_mode 'mix'           w2  [ pass ]  66867
[ 19%] rpl_nogtid.rpl_gtid_mode 'mix'           w5  [ pass ]  64780
[ 20%] rpl_nogtid.rpl_gtid_mode 'row'           w6  [ pass ]  67074
[ 21%] rpl_nogtid.rpl_gtid_mode 'row'           w1  [ pass ]  57813
[ 23%] rpl_nogtid.rpl_gtid_mode 'stmt'          w8  [ pass ]  60157
[ 24%] rpl_nogtid.rpl_gtid_mode 'stmt'          w4  [ pass ]  60097
[ 25%] rpl_nogtid.rpl_gtid_mode 'row'           w3  [ pass ]  60157
[ 26%] rpl_nogtid.rpl_gtid_mode 'row'           w7  [ pass ]  61386
[ 27%] rpl_nogtid.rpl_gtid_mode 'mix'           w5  [ pass ]  65837
[ 28%] rpl_nogtid.rpl_gtid_mode 'mix'           w2  [ pass ]  71053
[ 29%] rpl_nogtid.rpl_gtid_mode 'row'           w6  [ pass ]  69157
[ 30%] rpl_nogtid.rpl_gtid_mode 'row'           w1  [ pass ]  71885
[ 31%] rpl_nogtid.rpl_gtid_mode 'stmt'          w4  [ pass ]  66189
[ 32%] rpl_nogtid.rpl_gtid_mode 'row'           w7  [ pass ]  65548
[ 34%] rpl_nogtid.rpl_gtid_mode 'row'           w3  [ pass ]  66692
[ 35%] rpl_nogtid.rpl_gtid_mode 'stmt'          w8  [ pass ]  66797
[ 36%] rpl_nogtid.rpl_gtid_mode 'mix'           w2  [ pass ]  65582
[ 37%] rpl_nogtid.rpl_gtid_mode 'mix'           w5  [ pass ]  66841
[ 38%] rpl_nogtid.rpl_gtid_mode 'row'           w6  [ pass ]  64213
[ 39%] rpl_nogtid.rpl_gtid_mode 'row'           w1  [ pass ]  62164
[ 40%] rpl_nogtid.rpl_gtid_mode 'stmt'          w8  [ pass ]  58974
[ 41%] rpl_nogtid.rpl_gtid_mode 'row'           w7  [ pass ]  62065
[ 42%] rpl_nogtid.rpl_gtid_mode 'row'           w3  [ pass ]  63396
[ 43%] rpl_nogtid.rpl_gtid_mode 'stmt'          w4  [ pass ]  64839
[ 45%] rpl_nogtid.rpl_gtid_mode 'row'           w3  [ fail ]
        Test ended at 2020-08-29 09:37:28

CURRENT_TEST: rpl_nogtid.rpl_gtid_mode
mysqltest: At line 98: Slave stopped with wrong error code
In included file ./include/wait_for_slave_io_error.inc: 99
included from ../mysql-8.0.21/mysql-test/suite/rpl_nogtid/t/rpl_gtid_mode.test: 561

The result from queries just before the failure was:
Log_name        Pos     Event_type      Server_id       End_log_pos     Info

**** slave_relay_info on server_1 ****
SELECT * FROM mysql.slave_relay_log_info;
Number_of_lines Relay_log_name  Relay_log_pos   Master_log_name Master_log_pos  Sql_delay       Number_of_workers       Id      Channel_name    Privilege_checks_username       Privilege_checks_hostname   Require_row_format       Require_table_primary_key_check

**** slave_master_info on server_1 ****
SELECT * FROM mysql.slave_master_info;
Number_of_lines Master_log_name Master_log_pos  Host    User_name       User_password   Port    Connect_retry   Enabled_ssl     Ssl_ca  Ssl_capath      Ssl_cert        Ssl_cipher      Ssl_key Ssl_verify_server_cert       Heartbeat       Bind    Ignored_server_ids      Uuid    Retry_count     Ssl_crl Ssl_crlpath     Enabled_auto_position   Channel_name    Tls_version     Public_key_path Get_public_key  Network_namespace    Master_compression_algorithm    Master_zstd_compression_level   Tls_ciphersuites

**** mysql.gtid_executed on server_1 ****
SELECT * FROM mysql.gtid_executed;
source_uuid     interval_start  interval_end
1975859a-e998-11ea-9c5e-fa163ebe3932    1       2
rpl_topology= 1->2
rand_seed: '' _rand_state: ''
extra debug info if any: ''
rpl_topology=1->2
connection slave;
**** Slave stopped with wrong error code: 13148 (expected 13122 # ER_SLAVE_RELAY_LOG_WRITE_FAILURE) ****
safe_process[22828]: Child process: 22829, exit: 1

 - the logfile can be found in '../mysql-8.0.21/cmake_build/mysql-test/var/log/rpl_nogtid.rpl_gtid_mode-row/rpl_gtid_mode.log'

Only  41  of 90 completed.
mysql-test-run: *** ERROR: Not all tests completed

How to repeat:
./mtr rpl_nogtid.rpl_gtid_mode{,,} --parallel=8 --repeat=10
[31 Aug 2020 8:54] MySQL Verification Team
Hello zhijun long,

Thank you for the report and feedback.

regards,
Umesh