MySQL Bugs: #111444: Assertion `inited == NONE || table->open_by

Bug #111444	Assertion `inited == NONE \|\| table->open_by_handler' failed.
Submitted:	15 Jun 19:32	Modified:	16 Jun 4:39
Reporter:	Yu Liang	Email Updates:
Status:	Verified	Impact on me:	None
Category:	MySQL Server: Optimizer	Severity:	S6 (Debug Builds)
Version:	8.0.33	OS:	Ubuntu (20.04 LTS)
Assigned to:		CPU Architecture:	x86 (Intel(R) Core(TM) i7-10700 CPU)

Description:
The latest version of the MySQL Server (version 8.0.33 debug build) (git commit hash: ea7087d8850) crashes with Assertion Failure when executing the following query:

Config from "/etc/mysql/conf.d/mysql.cnf":

```
[mysqld]
sql_mode = "NO_ENGINE_SUBSTITUTION"
```

```sql
drop database if exists test123;
create database test123;
use test123;
create table v0(c1 INT);
CREATE TABLE IF NOT EXISTS v2 ( CONSTRAINT c3 PRIMARY KEY i6 TYPE BTREE ( c1 ) ) INSERT_METHOD = LAST STORAGE MEMORY AS TABLE v0;
INSERT v0 SET c1 = c1 ;
CREATE VIEW v4 AS TABLE v0 UNION DISTINCT TABLE v2 ORDER BY c1 IN ( TABLE v2 ) ;
TABLE v0 ORDER BY 'any_random_text' IN ( TABLE v4) ;
```

In the debug build, the server crashes with the following stack trace: 

```
mysql> TABLE v0 ORDER BY 'any_random_text' IN ( TABLE v4) ;
mysqld: /home/mysql/mysql-server/sql/handler.cc:7880: int handler::ha_external_lock(THD *, int): Assertion `inited == NONE || table->open_by_handler' failed.
2023-06-15T19:29:32Z UTC - mysqld got signal 6 ;
Most likely, you have hit a bug, but this error can also be caused by malfunctioning hardware.
BuildID[sha1]=1d55d4671b7469352fc317efb0121b604c26443d
Thread pointer: 0xfffee0001040
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = ffff84545538 thread_stack 0x100000
/home/mysql/mysql-server/bld/runtime_output_directory/mysqld(my_print_stacktrace(unsigned char const*, unsigned long)+0x60) [0x4e6bc30]
/home/mysql/mysql-server/bld/runtime_output_directory/mysqld(print_fatal_signal(int)+0x340) [0x1a89320]
/home/mysql/mysql-server/bld/runtime_output_directory/mysqld(handle_fatal_signal+0x16c) [0x1a896dc]
linux-vdso.so.1(__kernel_rt_sigreturn+0) [0xffff88be87a0]
/lib/aarch64-linux-gnu/libc.so.6(gsignal+0xe0) [0xffff8825cd78]
/lib/aarch64-linux-gnu/libc.so.6(abort+0x114) [0xffff88249aac]
/lib/aarch64-linux-gnu/libc.so.6(+0x2d490) [0xffff88256490]
/lib/aarch64-linux-gnu/libc.so.6(+0x2d4f4) [0xffff882564f4]
/home/mysql/mysql-server/bld/runtime_output_directory/mysqld(handler::ha_external_lock(THD*, int)+0x36c) [0x1e03c20]
/home/mysql/mysql-server/bld/runtime_output_directory/mysqld() [0x2370054]
/home/mysql/mysql-server/bld/runtime_output_directory/mysqld(mysql_unlock_read_tables(THD*, MYSQL_LOCK*)+0x2c0) [0x2370648]
/home/mysql/mysql-server/bld/runtime_output_directory/mysqld(JOIN::join_free()+0x394) [0x174ca08]
/home/mysql/mysql-server/bld/runtime_output_directory/mysqld() [0x18b76f4]
/home/mysql/mysql-server/bld/runtime_output_directory/mysqld(Query_expression::ExecuteIteratorQuery(THD*)+0x1008) [0x18b6d80]
/home/mysql/mysql-server/bld/runtime_output_directory/mysqld(Query_expression::execute(THD*)+0x140) [0x18b7a50]
/home/mysql/mysql-server/bld/runtime_output_directory/mysqld(Sql_cmd_dml::execute_inner(THD*)+0x144) [0x1739e88]
/home/mysql/mysql-server/bld/runtime_output_directory/mysqld(Sql_cmd_dml::execute(THD*)+0x7a0) [0x1737e1c]
/home/mysql/mysql-server/bld/runtime_output_directory/mysqld(mysql_execute_command(THD*, bool)+0x281c) [0x162bcd8]
/home/mysql/mysql-server/bld/runtime_output_directory/mysqld(dispatch_sql_command(THD*, Parser_state*)+0x1124) [0x16252c0]
/home/mysql/mysql-server/bld/runtime_output_directory/mysqld(dispatch_command(THD*, COM_DATA const*, enum_server_command)+0x5434) [0x161e224]
/home/mysql/mysql-server/bld/runtime_output_directory/mysqld(do_command(THD*)+0xb8c) [0x16228f4]
/home/mysql/mysql-server/bld/runtime_output_directory/mysqld() [0x1a59a64]
/home/mysql/mysql-server/bld/runtime_output_directory/mysqld() [0x655c1a0]
/lib/aarch64-linux-gnu/libpthread.so.0(+0x7624) [0xffff88b8e624]
/lib/aarch64-linux-gnu/libc.so.6(+0xd149c) [0xffff882fa49c]

Trying to get some variables.
Some pointers may be invalid and cause the dump to abort.
Query (fffee01f4890): TABLE v0 ORDER BY 'any_random_text' IN ( TABLE v4)
Connection ID (thread ID): 8
Status: NOT_KILLED
```

How to repeat:
Steps to repeat the Assertion Failure:
1. Download the MySQL Server source code from the official github repo: `https://github.com/mysql/mysql-server`
2. Checkout to the latest mysql released version: 8.0.33 (hash: `ea7087d8850`)
3. Compile MySQL using the command: 

```
mkdir -p bld
cd bld
cmake .. -DDOWNLOAD_BOOST=1 -DWITH_BOOST=../boost -DWITH_UNIT_TESTS=OFF -DWITH_DEBUG=1
make
```

4. Run the MySQL Server with command: 

```
./bin/mysqld --basedir=$(pwd) --datadir=$(pwd)/data_all/ori_data --port=7000  --socket=/tmp/mysql_0.sock --mysqlx=OFF --performance_schema=OFF
```

5. Setup the MySQL Server config in the path: "/etc/mysql/conf.d/mysql.cnf"

```
[mysqld]
sql_mode = "NO_ENGINE_SUBSTITUTION"
```

6. Run the MySQL Client with the PoC:

```
./bin/mysql --port=7000 --user=root --socket=/tmp/mysql_0.sock < poc_0.sql
```

where `poc_0.sql` is:

```sql
drop database if exists test123;
create database test123;
use test123;
create table v0(c1 INT);
CREATE TABLE IF NOT EXISTS v2 ( CONSTRAINT c3 PRIMARY KEY i6 TYPE BTREE ( c1 ) ) INSERT_METHOD = LAST STORAGE MEMORY AS TABLE v0;
INSERT v0 SET c1 = c1 ;
CREATE VIEW v4 AS TABLE v0 UNION DISTINCT TABLE v2 ORDER BY c1 IN ( TABLE v2 ) ;
TABLE v0 ORDER BY 'any_random_text' IN ( TABLE v4) ;
```

Suggested fix:
The server should continue running instead of crashing by Assertion Failure.

Hello Yu Liang,

Thank you for the report and test case.
Observed that 8.0.33 debug build is affected.

regards,
Umesh

-- release build - not affected
./mtr bug111444 --nocheck-testcases
Logging: ./mtr  bug111444 --nocheck-testcases
MySQL Version 8.0.33
Checking supported features
Using 'all' suites
Collecting tests
Checking leftover processes
Removing old var directory
 - WARNING: Using the 'mysql-test/var' symlink
Creating var directory '/export/home/tmp/ushastry/mysql-8.0.33/mysql-test/var'
Installing system database
Using parallel: 1

==============================================================================
                  TEST NAME                       RESULT  TIME (ms) COMMENT
------------------------------------------------------------------------------
drop database if exists test123;
Warnings:
Note    1008    Can't drop database 'test123'; database doesn't exist
create database test123;
use test123;
create table v0(c1 INT);
CREATE TABLE IF NOT EXISTS v2 ( CONSTRAINT c3 PRIMARY KEY i6 TYPE BTREE ( c1 ) ) INSERT_METHOD = LAST STORAGE MEMORY AS TABLE v0;
INSERT v0 SET c1 = c1 ;
CREATE VIEW v4 AS TABLE v0 UNION DISTINCT TABLE v2 ORDER BY c1 IN ( TABLE v2 ) ;
TABLE v0 ORDER BY 'any_random_text' IN ( TABLE v4) ;
c1
NULL
[ 50%] main.bug111444                            [ pass ]     12
[100%] shutdown_report                           [ pass ]
------------------------------------------------------------------------------

-- debug build - affected
./mtr bug111444 --nocheck-testcases --debug-server
Logging: ./mtr  bug111444 --nocheck-testcases --debug-server
MySQL Version 8.0.33
Checking supported features
 - Binaries are debug compiled
Using 'all' suites
Collecting tests
Checking leftover processes
Removing old var directory
 - WARNING: Using the 'mysql-test/var' symlink
Creating var directory '/export/home/tmp/ushastry/mysql-8.0.33/mysql-test/var'
Installing system database
Using parallel: 1

==============================================================================
                  TEST NAME                       RESULT  TIME (ms) COMMENT
------------------------------------------------------------------------------
drop database if exists test123;
Warnings:
Note    1008    Can't drop database 'test123'; database doesn't exist
create database test123;
use test123;
create table v0(c1 INT);
CREATE TABLE IF NOT EXISTS v2 ( CONSTRAINT c3 PRIMARY KEY i6 TYPE BTREE ( c1 ) ) INSERT_METHOD = LAST STORAGE MEMORY AS TABLE v0;
INSERT v0 SET c1 = c1 ;
CREATE VIEW v4 AS TABLE v0 UNION DISTINCT TABLE v2 ORDER BY c1 IN ( TABLE v2 ) ;
TABLE v0 ORDER BY 'any_random_text' IN ( TABLE v4) ;
[ 50%] main.bug111444                            [ fail ]
        Test ended at 2023-06-16 06:39:30

CURRENT_TEST: main.bug111444
mysqltest: At line 8: Query 'TABLE v0 ORDER BY 'any_random_text' IN ( TABLE v4) ' failed.
ERROR 2013 (HY000): Lost connection to MySQL server during query

#0  0x00007f9ea907faa1 in pthread_kill () from /lib64/libpthread.so.0
#1  0x0000000003f9296e in my_write_core(int) ()
#2  0x00000000032365f5 in handle_fatal_signal ()
#3  <signal handler called>
#4  0x00007f9ea72b9387 in raise () from /lib64/libc.so.6
#5  0x00007f9ea72baa78 in abort () from /lib64/libc.so.6
#6  0x00007f9ea72b21a6 in __assert_fail_base () from /lib64/libc.so.6
#7  0x00007f9ea72b2252 in __assert_fail () from /lib64/libc.so.6
#8  0x0000000003348d7e in handler::ha_external_lock(THD*, int) ()
#9  0x00000000034d5fcf in unlock_external(THD*, TABLE**, unsigned int) ()
#10 0x00000000034d6ade in mysql_unlock_read_tables(THD*, MYSQL_LOCK*) ()
#11 0x000000000311e6a5 in JOIN::join_free() ()
#12 0x000000000318d699 in Query_expression::ExecuteIteratorQuery(THD*)::{lambda()#1}::operator()() const ()
#13 0x000000000318d723 in Scope_guard<Query_expression::ExecuteIteratorQuery(THD*)::{lambda()#1}>::~Scope_guard() ()
#14 0x0000000003190a98 in Query_expression::ExecuteIteratorQuery(THD*) ()
#15 0x0000000003190b92 in Query_expression::execute(THD*) ()
#16 0x000000000311a12a in Sql_cmd_dml::execute_inner(THD*) ()
#17 0x0000000003123873 in Sql_cmd_dml::execute(THD*) ()
#18 0x00000000030c4964 in mysql_execute_command(THD*, bool) ()
#19 0x00000000030c5dc9 in dispatch_sql_command(THD*, Parser_state*) ()
#20 0x00000000030c752b in dispatch_command(THD*, COM_DATA const*, enum_server_command) ()
#21 0x00000000030c926e in do_command(THD*) ()
#22 0x0000000003227bb7 in handle_connection ()
#23 0x0000000004743af9 in pfs_spawn_thread ()
#24 0x00007f9ea907aea5 in start_thread () from /lib64/libpthread.so.0
#25 0x00007f9ea7381b2d in clone () from /lib64/libc.so.6