Bug #93166 Test `binlog_gtid.binlog_gtid_mysqldump` in mysql-test is flaky
Submitted: 12 Nov 2018 23:04 Modified: 13 Nov 2018 14:17
Reporter: Ran Ang Email Updates:
Status: Closed Impact on me:
None 
Category:MySQL Server: Tests Severity:S7 (Test Cases)
Version:8.0.13 OS:Ubuntu (4.15.0-38-generic #41~16.04.1-Ubuntu)
Assigned to: CPU Architecture:x86

[12 Nov 2018 23:04] Ran Ang
Description:
The newest stable version (8.0.13) fails the tests. 

I reproduced this using both official pre-built binaries (downloaded from the official site, https://dev.mysql.com/downloads/mysql/) and builds from source code based on the GitHub branch 8.0 (https://github.com/mysql/mysql-server). 

This indicates either bugs in the code, or the tests are flaky (which is more likely so).

Here are the relevant logs when running the tests:

[ 12%] binlog_gtid.binlog_gtid_mysqldump 'stmt' [ fail ]
        Test ended at 2018-11-12 16:39:47

MTR's internal check of the test case 'binlog_gtid.binlog_gtid_mysqldump' failed.
This means that the test case does not preserve the state that existed
before the test case was executed.  Most likely the test case did not
do a proper clean-up. It could also be caused by the previous test run
by this thread, if the server wasn't restarted.
This is the diff of the states of the servers before and after the
test case was executed:
mysqltest: Results saved in '/home/elaine/config-test/fresh/mysql-8.0.13-linux-glibc2.12-x86_64/mysql-test/var/tmp/check-mysqld_1.result'.
mysqltest: Logging to '/home/elaine/config-test/fresh/mysql-8.0.13-linux-glibc2.12-x86_64/mysql-test/var/tmp/check-mysqld_1.log'.
mysqltest: Connecting to server localhost:10310 (socket /home/elaine/config-test/fresh/mysql-8.0.13-linux-glibc2.12-x86_64/mysql-test/var/tmp/mysqld.1.sock) as 'root', connection 'default', attempt 0 ...
mysqltest: ... Connected.
mysqltest: Start processing test commands from './include/check-testcase.test' ...
mysqltest: ... Done processing test commands.
--- /home/elaine/config-test/fresh/mysql-8.0.13-linux-glibc2.12-x86_64/mysql-test/var/tmp/check-mysqld_1.result 2018-11-13 01:39:24.992810826 +0300
+++ /home/elaine/config-test/fresh/mysql-8.0.13-linux-glibc2.12-x86_64/mysql-test/var/tmp/check-mysqld_1.reject 2018-11-13 01:39:47.317291601 +0300
@@ -71,6 +71,7 @@
 mysqld.1.pid
 #-------------- MYSQLTEST_VARDIR/tmp --------------
 mysqld.1
+mysqldump.sql
 #------------- MYSQLTEST_VARDIR/std_data ------------
 .mylogin.cnf
 14897.frm

mysqltest: Result content mismatch

not ok
safe_process[23089]: Child process: 23090, exit: 1

 - the logfile can be found in '/home/elaine/config-test/fresh/mysql-8.0.13-linux-glibc2.12-x86_64/mysql-test/var/log/binlog_gtid.binlog_gtid_mysqldump-stmt/binlog_gtid_mysqldump.log'

Only  757  of 6303 completed.
mysql-test-run: *** ERROR: Not all tests completed

How to repeat:
You can reproduce this using either binaries from the official download page, or build from the source code in GitHub.

The easiest way to produce is to download prebuilt binaries (which saves you the building time):

1. download 8.0.13 (Linux Generic) from https://dev.mysql.com/downloads/mysql/:
   * mysql-8.0.13-linux-glibc2.12-x86_64.tar.xz
   * mysql-test-8.0.13-linux-glibc2.12-x86_64.tar.xz

2. tar xf mysql-8.0.13-linux-glibc2.12-x86_64.tar.xz
   tar xf mysql-test-8.0.13-linux-glibc2.12-x86_64.tar.xz

3. cd mysql-test

4. ./mysql-test-run.pl
[13 Nov 2018 5:34] MySQL Verification Team
Hello Ran Ang,

Thank you for the report and feedback!

regards,
Umesh
[13 Nov 2018 14:17] Paul DuBois
Posted by developer:
 
Fixed in 8.0.14.

Work was done for test suite. No changelog entry needed.