Bug #79569 Some --big-test tests were forgotten to update in 5.7.10
Submitted: 9 Dec 2015 8:42 Modified: 11 Dec 2015 13:55
Reporter: Laurynas Biveinis (OCA) Email Updates:
Status: Closed Impact on me:
None 
Category:MySQL Server: Tests Severity:S3 (Non-critical)
Version:5.7.10 OS:Any
Assigned to: CPU Architecture:Any
Tags: mtr

[9 Dec 2015 8:42] Laurynas Biveinis
Description:
For example,

rpl.rpl_row_mts_crash_safe 'row'         [ fail ]
        Test ended at 2015-12-09 08:35:37

CURRENT_TEST: rpl.rpl_row_mts_crash_safe
--- /Users/laurynas/percona/mysql-5.7.10/mysql-test/suite/rpl/r/rpl_row_mts_crash_safe.result	2015-11-29 22:02:24.000000000 +0300
+++ /Users/laurynas/percona/obj-mysql-5.7.10-asan/mysql-test/var/log/rpl_row_mts_crash_safe.reject	2015-12-09 09:35:36.000000000 +0300
@@ -351,6 +351,7 @@
   `Ssl_crlpath` text CHARACTER SET utf8 COLLATE utf8_bin COMMENT 'The path used for Certificate Revocation List (CRL) files',
   `Enabled_auto_position` tinyint(1) NOT NULL COMMENT 'Indicates whether GTIDs will be used to retrieve events from the master.',
   `Channel_name` char(64) NOT NULL COMMENT 'The channel on which the slave is connected to a source. Used in Multisource Replication',
+  `Tls_version` text CHARACTER SET utf8 COLLATE utf8_bin COMMENT 'Tls version',
   PRIMARY KEY (`Channel_name`)
 ) ENGINE=InnoDB DEFAULT CHARSET=utf8 STATS_PERSISTENT=0 COMMENT='Master Information'
 SHOW CREATE TABLE mysql.slave_relay_log_info;
@@ -415,6 +416,7 @@
   `Ssl_crlpath` text CHARACTER SET utf8 COLLATE utf8_bin COMMENT 'The path used for Certificate Revocation List (CRL) files',
   `Enabled_auto_position` tinyint(1) NOT NULL COMMENT 'Indicates whether GTIDs will be used to retrieve events from the master.',
   `Channel_name` char(64) NOT NULL COMMENT 'The channel on which the slave is connected to a source. Used in Multisource Replication',
+  `Tls_version` text CHARACTER SET utf8 COLLATE utf8_bin COMMENT 'Tls version',
   PRIMARY KEY (`Channel_name`)
 ) ENGINE=InnoDB DEFAULT CHARSET=utf8 STATS_PERSISTENT=0 COMMENT='Master Information'
 SHOW CREATE TABLE mysql.slave_relay_log_info;

mysqltest: Result content mismatch

How to repeat:
$ ./mtr --debug-server rpl_row_mts_crash_safe --big-test
$ ./mtr --debug-server rpl_row_mts_rec_crash_safe  --big-test
$ ./mtr --debug-server rpl_stm_mixed_mts_crash_safe --big-test
$ ./mtr --debug-server rpl_stm_mixed_mts_rec_crash_safe --big-test
$ ./mtr --debug-server rpl_stm_mixed_mts_rec_crash_safe_checksum --big-test

Suggested fix:
Keep on running --big-test?
[9 Dec 2015 8:42] Laurynas Biveinis
Editing title
[9 Dec 2015 9:13] Laurynas Biveinis
Also innodb_zip.16k, same root cause (mysql.slave_master_info schema change):

$ ./mtr --debug-server 16k --big-test
...
innodb_zip.16k                           [ fail ]
        Test ended at 2015-12-09 11:12:23

CURRENT_TEST: innodb_zip.16k
--- /Users/laurynas/percona/mysql-5.7.10/mysql-test/suite/innodb_zip/r/16k.result	2015-11-29 22:02:24.000000000 +0300
+++ /Users/laurynas/percona/obj-mysql-5.7.10-asan/mysql-test/var/log/16k.reject	2015-12-09 12:12:22.000000000 +0300
@@ -34,7 +34,7 @@
 mysql/plugin	5	33	PRIMARY	3	3	1	50
 mysql/servers	12	33	PRIMARY	3	3	1	50
 mysql/server_cost	7	33	PRIMARY	3	3	1	50
-mysql/slave_master_info	27	33	PRIMARY	3	3	1	50
+mysql/slave_master_info	28	33	PRIMARY	3	3	1	50
 mysql/slave_relay_log_info	12	33	PRIMARY	3	3	1	50
 mysql/slave_worker_info	16	33	PRIMARY	3	3	2	50
 mysql/time_zone	5	33	PRIMARY	3	3	1	50

mysqltest: Result content mismatch
[9 Dec 2015 9:31] MySQL Verification Team
Hello Laurynas,

Thank you for the report.

Thanks,
Umesh
[9 Dec 2015 9:33] MySQL Verification Team
// source build
[umshastr@hod03]/export/umesh/server/source/bugs/mysql-5.7.10: cmake -DWITH_SSL=bundled -DDOWNLOAD_BOOST=1 -DWITH_BOOST=../boost/ -DWITH_DEBUG=ON
[umshastr@hod03]/export/umesh/server/source/bugs/mysql-5.7.10: make
[umshastr@hod03]/export/umesh/server/source/bugs/mysql-5.7.10: cd mysql-test

[umshastr@hod03]/export/umesh/server/source/bugs/mysql-5.7.10/mysql-test: ./mtr --debug-server rpl_row_mts_crash_safe --big-test
Logging: ./mtr  --debug-server rpl_row_mts_crash_safe --big-test
MySQL Version 5.7.10
Checking supported features...
 - SSL connections supported
 - binaries are debug compiled
Collecting tests...
 - adding combinations for rpl
Checking leftover processes...
Removing old var directory...
Creating var directory '/export/umesh/server/source/bugs/mysql-5.7.10/mysql-test/var'...
Installing system database...

==============================================================================

TEST                                      RESULT   TIME (ms) or COMMENT
--------------------------------------------------------------------------

worker[1] Using MTR_BUILD_THREAD 300, with reserved ports 13000..13009
rpl.rpl_row_mts_crash_safe 'mix'         [ skipped ]  Doesn't support --binlog-format='mixed'
rpl.rpl_row_mts_crash_safe 'row'         [ fail ]
        Test ended at 2015-12-09 10:29:06

CURRENT_TEST: rpl.rpl_row_mts_crash_safe
--- /export/umesh/server/source/bugs/mysql-5.7.10/mysql-test/suite/rpl/r/rpl_row_mts_crash_safe.result  2015-11-29 22:16:24.000000000 +0300
+++ /export/umesh/server/source/bugs/mysql-5.7.10/mysql-test/var/log/rpl_row_mts_crash_safe.reject      2015-12-09 12:29:05.599963439 +0300
@@ -351,6 +351,7 @@
   `Ssl_crlpath` text CHARACTER SET utf8 COLLATE utf8_bin COMMENT 'The path used for Certificate Revocation List (CRL) files',
   `Enabled_auto_position` tinyint(1) NOT NULL COMMENT 'Indicates whether GTIDs will be used to retrieve events from the master.',
   `Channel_name` char(64) NOT NULL COMMENT 'The channel on which the slave is connected to a source. Used in Multisource Replication',
+  `Tls_version` text CHARACTER SET utf8 COLLATE utf8_bin COMMENT 'Tls version',
   PRIMARY KEY (`Channel_name`)
 ) ENGINE=InnoDB DEFAULT CHARSET=utf8 STATS_PERSISTENT=0 COMMENT='Master Information'
 SHOW CREATE TABLE mysql.slave_relay_log_info;
@@ -415,6 +416,7 @@
   `Ssl_crlpath` text CHARACTER SET utf8 COLLATE utf8_bin COMMENT 'The path used for Certificate Revocation List (CRL) files',
   `Enabled_auto_position` tinyint(1) NOT NULL COMMENT 'Indicates whether GTIDs will be used to retrieve events from the master.',
   `Channel_name` char(64) NOT NULL COMMENT 'The channel on which the slave is connected to a source. Used in Multisource Replication',
+  `Tls_version` text CHARACTER SET utf8 COLLATE utf8_bin COMMENT 'Tls version',
   PRIMARY KEY (`Channel_name`)
 ) ENGINE=InnoDB DEFAULT CHARSET=utf8 STATS_PERSISTENT=0 COMMENT='Master Information'
 SHOW CREATE TABLE mysql.slave_relay_log_info;

mysqltest: Result content mismatch

safe_process[24784]: Child process: 24785, exit: 1

 - the logfile can be found in '/export/umesh/server/source/bugs/mysql-5.7.10/mysql-test/var/log/rpl.rpl_row_mts_crash_safe-row/rpl_row_mts_crash_safe.log'

Only  2  of 3 completed.
mysql-test-run: *** ERROR: Not all tests completed
[11 Dec 2015 6:54] Erlend Dahl
This was noted internally and fixed, but the unfortunately fix didn't reach the release clone. The failures will be gone in 5.7.11.
[11 Dec 2015 13:55] Paul DuBois
Fixed in 5.7.11.

Changes for test suite. No changelog entry needed.