Bug #12117 "Show tables" on cluster replication can cause additional mysqld to crash
Submitted: 22 Jul 2005 15:20 Modified: 25 Jul 2005 21:26
Reporter: Jonathan Miller Email Updates:
Status: Closed Impact on me:
None 
Category:MySQL Cluster: Cluster (NDB) storage engine Severity:S1 (Critical)
Version:5.1 internal wl clone OS:Linux (Linux)
Assigned to: Tomas Ulin CPU Architecture:Any

[22 Jul 2005 15:20] Jonathan Miller 
Description:
Master:
3 Mysqld processes on 3 different computers (mysqld#1 (master), mysqld#2 (master failover) and mysqld#3 (master failover))
Slave:
3 Mysqld processes on 3 different computers (mysqld#4 (slave), mysqld#5 (slave failover) and mysqld#3 (slave failover))

I dropped all the databases on mysqld#1. Then issues master reset.
I dropped all the databases on mysqld#4. Then issues slave reset, slave start;
I created all databases using mysqld#1 and they were replicated.

I had not dropped database or done master resets on mysqld#2 or mysqld#3. Instead I did use database X; show tables; both mysqld processes crashed.

--------------------------------------------------------------------------------------------------------------
mysql> USE BANK;
Database changed
mysql> show tables;
ERROR 2006 (HY000): MySQL server has gone away
No connection. Trying to reconnect...
Connection id:    2
Current database: BANK

ERROR 2013 (HY000): Lost connection to MySQL server during query
mysql> show tables;
ERROR 2006 (HY000): MySQL server has gone away
No connection. Trying to reconnect...
ERROR 2002 (HY000): Can't connect to local MySQL server through socket '/tmp/mysql.sock' (111)
ERROR:
Can't connect to the server

mysql> exit
----------------------------------------------------------------------------------------------------------

In the error log I found garbage and 2 stack traces. Note Stack traces are resloved below log data.

********************************************************************************************
050722 16:39:30 [Note] NDB Binlog: drop table BANK/GL.
050722 16:39:30 [Note] NDB Binlog: drop table BANK/ACCOUNT.
050722 16:39:30 [Note] NDB Binlog: drop table BANK/TRANSACTION.
050722 16:39:31 [Note] NDB Binlog: drop table BANK/SYSTEM_VALUES.
050722 16:39:32 [Note] NDB Binlog: drop table BANK/ACCOUNT_TYPES.
050722 16:52:05 [Note] NDB Binlog: DISCOVER TABLE Event: REPL$TPCB/history
050722 16:52:05 [Note] NDB Binlog: replicating REPL$TPCB/history.
050722 16:52:05 [Note] NDB Binlog: DISCOVER TABLE Event: REPL$TPCB/account
050722 16:52:05 [Note] NDB Binlog: replicating REPL$TPCB/account.
050722 16:52:06 [Note] NDB Binlog: DISCOVER TABLE Event: REPL$TPCB/branch
050722 16:52:06 [Note] NDB Binlog: replicating REPL$TPCB/branch.
050722 16:52:06 [Note] NDB Binlog: DISCOVER TABLE Event: REPL$TPCB/teller
050722 16:52:06 [Note] NDB Binlog: replicating REPL$TPCB/teller.
050722 16:52:16 [ERROR] NDB_SHARE: ./BANK/SYSTEM_VALUES already exists, use_count=1. Moving away for safety, but possible memleak.
050722 16:52:16 [Note] NDB Binlog: DISCOVER TABLE Event: REPL$BANK/SYSTEM_VALUES
NdbEventOperationImpl::getValue attribute D�"@D�"@L�"@L�"@T�"@T�"@\�"@\�"@d�"@d�"@��t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@ĭ"@ĭ"@̭"@̭"@ԭ"@ԭ"@ܭ"@ܭ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
                                            �"@
                                               �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@4�"@4�"@<�"@<�"@D�"@D�"@L�"@L�"@T�"@T�"@\�"@\�"@d�"@d�"@l�"@l�"@t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@Į"@Į"@̮"@̮"@Ԯ"@Ԯ"@ܮ"@ܮ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
           �"@
              �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@4�"@4�"@<�"@<�"@D�"@D�"@L�"@L�"@T�"@T�"@\�"@\�"@d�"@d�"@l�"@l�"@t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@į"@į"@̯"@̯"@ԯ"@ԯ"@ܯ"@ܯ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
                                                                       �"@
                                                                          �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@ not found
NdbEventOperationImpl::getValue attribute D�"@D�"@L�"@L�"@T�"@T�"@\�"@\�"@d�"@d�"@��t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@ĭ"@ĭ"@̭"@̭"@ԭ"@ԭ"@ܭ"@ܭ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
                                            �"@
                                               �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@4�"@4�"@<�"@<�"@D�"@D�"@L�"@L�"@T�"@T�"@\�"@\�"@d�"@d�"@l�"@l�"@t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@Į"@Į"@̮"@̮"@Ԯ"@Ԯ"@ܮ"@ܮ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
           �"@
              �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@4�"@4�"@<�"@<�"@D�"@D�"@L�"@L�"@T�"@T�"@\�"@\�"@d�"@d�"@l�"@l�"@t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@į"@į"@̯"@̯"@ԯ"@ԯ"@ܯ"@ܯ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
                                                                       �"@
                                                                          �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@ not found
NdbEventOperationImpl::getValue attribute D�"@D�"@L�"@L�"@T�"@T�"@\�"@\�"@d�"@d�"@��t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@ĭ"@ĭ"@̭"@̭"@ԭ"@ԭ"@ܭ"@ܭ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
                                            �"@
                                               �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@4�"@4�"@<�"@<�"@D�"@D�"@L�"@L�"@T�"@T�"@\�"@\�"@d�"@d�"@l�"@l�"@t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@Į"@Į"@̮"@̮"@Ԯ"@Ԯ"@ܮ"@ܮ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
           �"@
              �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@4�"@4�"@<�"@<�"@D�"@D�"@L�"@L�"@T�"@T�"@\�"@\�"@d�"@d�"@l�"@l�"@t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@į"@į"@̯"@̯"@ԯ"@ԯ"@ܯ"@ܯ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
                                                                       �"@
                                                                          �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@ not found
NdbEventOperationImpl::getValue attribute D�"@D�"@L�"@L�"@T�"@T�"@\�"@\�"@d�"@d�"@��t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@ĭ"@ĭ"@̭"@̭"@ԭ"@ԭ"@ܭ"@ܭ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
                                            �"@
                                               �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@4�"@4�"@<�"@<�"@D�"@D�"@L�"@L�"@T�"@T�"@\�"@\�"@d�"@d�"@l�"@l�"@t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@Į"@Į"@̮"@̮"@Ԯ"@Ԯ"@ܮ"@ܮ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
           �"@
              �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@4�"@4�"@<�"@<�"@D�"@D�"@L�"@L�"@T�"@T�"@\�"@\�"@d�"@d�"@l�"@l�"@t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@į"@į"@̯"@̯"@ԯ"@ԯ"@ܯ"@ܯ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
                                                                       �"@
                                                                          �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@ not found
NdbEventOperationImpl::getValue attribute L�"@L�"@T�"@T�"@\�"@\�"@d�"@d�"@��t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@ĭ"@ĭ"@̭"@̭"@ԭ"@ԭ"@ܭ"@ܭ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
                                    �"@
                                       �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@4�"@4�"@<�"@<�"@D�"@D�"@L�"@L�"@T�"@T�"@\�"@\�"@d�"@d�"@l�"@l�"@t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@Į"@Į"@̮"@̮"@Ԯ"@Ԯ"@ܮ"@ܮ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
   �"@
      �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@4�"@4�"@<�"@<�"@D�"@D�"@L�"@L�"@T�"@T�"@\�"@\�"@d�"@d�"@l�"@l�"@t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@į"@į"@̯"@̯"@ԯ"@ԯ"@ܯ"@ܯ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
                                                               �"@
                                                                  �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@ not found
NdbEventOperationImpl::getValue attribute L�"@L�"@T�"@T�"@\�"@\�"@d�"@d�"@��t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@ĭ"@ĭ"@̭"@̭"@ԭ"@ԭ"@ܭ"@ܭ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
                                    �"@
                                       �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@4�"@4�"@<�"@<�"@D�"@D�"@L�"@L�"@T�"@T�"@\�"@\�"@d�"@d�"@l�"@l�"@t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@Į"@Į"@̮"@̮"@Ԯ"@Ԯ"@ܮ"@ܮ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
   �"@
      �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@4�"@4�"@<�"@<�"@D�"@D�"@L�"@L�"@T�"@T�"@\�"@\�"@d�"@d�"@l�"@l�"@t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@į"@į"@̯"@̯"@ԯ"@ԯ"@ܯ"@ܯ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
                                                               �"@
                                                                  �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@ not found
NdbEventOperationImpl::getValue attribute L�"@L�"@T�"@T�"@\�"@\�"@d�"@d�"@��t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@ĭ"@ĭ"@̭"@̭"@ԭ"@ԭ"@ܭ"@ܭ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
                                    �"@
                                       �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@4�"@4�"@<�"@<�"@D�"@D�"@L�"@L�"@T�"@T�"@\�"@\�"@d�"@d�"@l�"@l�"@t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@Į"@Į"@̮"@̮"@Ԯ"@Ԯ"@ܮ"@ܮ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
   �"@
      �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@4�"@4�"@<�"@<�"@D�"@D�"@L�"@L�"@T�"@T�"@\�"@\�"@d�"@d�"@l�"@l�"@t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@į"@į"@̯"@̯"@ԯ"@ԯ"@ܯ"@ܯ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
                                                               �"@
                                                                  �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@ not found
NdbEventOperationImpl::getValue attribute L�"@L�"@T�"@T�"@\�"@\�"@d�"@d�"@��t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@ĭ"@ĭ"@̭"@̭"@ԭ"@ԭ"@ܭ"@ܭ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
                                    �"@
                                       �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@4�"@4�"@<�"@<�"@D�"@D�"@L�"@L�"@T�"@T�"@\�"@\�"@d�"@d�"@l�"@l�"@t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@Į"@Į"@̮"@̮"@Ԯ"@Ԯ"@ܮ"@ܮ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
   �"@
      �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@4�"@4�"@<�"@<�"@D�"@D�"@L�"@L�"@T�"@T�"@\�"@\�"@d�"@d�"@l�"@l�"@t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@į"@į"@̯"@̯"@ԯ"@ԯ"@ܯ"@ܯ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
                                                               �"@
                                                                  �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@ not found
NdbEventOperationImpl::getValue attribute T�"@T�"@\�"@\�"@d�"@d�"@��t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@ĭ"@ĭ"@̭"@̭"@ԭ"@ԭ"@ܭ"@ܭ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
                            �"@
                               �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@4�"@4�"@<�"@<�"@D�"@D�"@L�"@L�"@T�"@T�"@\�"@\�"@d�"@d�"@l�"@l�"@t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@Į"@Į"@̮"@̮"@Ԯ"@Ԯ"@ܮ"@ܮ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
                                                                                        �"@
                                                                                           �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@4�"@4�"@<�"@<�"@D�"@D�"@L�"@L�"@T�"@T�"@\�"@\�"@d�"@d�"@l�"@l�"@t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@į"@į"@̯"@̯"@ԯ"@ԯ"@ܯ"@ܯ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
                                                       �"@
                                                          �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@ not found
NdbEventOperationImpl::getValue attribute T�"@T�"@\�"@\�"@d�"@d�"@��t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@ĭ"@ĭ"@̭"@̭"@ԭ"@ԭ"@ܭ"@ܭ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
                            �"@
                               �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@4�"@4�"@<�"@<�"@D�"@D�"@L�"@L�"@T�"@T�"@\�"@\�"@d�"@d�"@l�"@l�"@t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@Į"@Į"@̮"@̮"@Ԯ"@Ԯ"@ܮ"@ܮ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
                                                                                        �"@
                                                                                           �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@4�"@4�"@<�"@<�"@D�"@D�"@L�"@L�"@T�"@T�"@\�"@\�"@d�"@d�"@l�"@l�"@t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@į"@į"@̯"@̯"@ԯ"@ԯ"@ܯ"@ܯ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
                                                       �"@
                                                          �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@ not found
NdbEventOperationImpl::getValue attribute T�"@T�"@\�"@\�"@d�"@d�"@��t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@ĭ"@ĭ"@̭"@̭"@ԭ"@ԭ"@ܭ"@ܭ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
                            �"@
                               �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@4�"@4�"@<�"@<�"@D�"@D�"@L�"@L�"@T�"@T�"@\�"@\�"@d�"@d�"@l�"@l�"@t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@Į"@Į"@̮"@̮"@Ԯ"@Ԯ"@ܮ"@ܮ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
                                                                                        �"@
                                                                                           �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@4�"@4�"@<�"@<�"@D�"@D�"@L�"@L�"@T�"@T�"@\�"@\�"@d�"@d�"@l�"@l�"@t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@į"@į"@̯"@̯"@ԯ"@ԯ"@ܯ"@ܯ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
                                                       �"@
                                                          �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@ not found
NdbEventOperationImpl::getValue attribute T�"@T�"@\�"@\�"@d�"@d�"@��t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@ĭ"@ĭ"@̭"@̭"@ԭ"@ԭ"@ܭ"@ܭ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
                            �"@
                               �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@4�"@4�"@<�"@<�"@D�"@D�"@L�"@L�"@T�"@T�"@\�"@\�"@d�"@d�"@l�"@l�"@t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@Į"@Į"@̮"@̮"@Ԯ"@Ԯ"@ܮ"@ܮ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
                                                                                        �"@
                                                                                           �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@4�"@4�"@<�"@<�"@D�"@D�"@L�"@L�"@T�"@T�"@\�"@\�"@d�"@d�"@l�"@l�"@t�"@t�"@|�"@|�"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@��"@į"@į"@̯"@̯"@ԯ"@ԯ"@ܯ"@ܯ"@��"@��"@��"@��"@��"@��"@��"@��"@�"@�"@
                                                       �"@
                                                          �"@�"@�"@�"@�"@$�"@$�"@,�"@,�"@ not found
mysqld got signal 11;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured. This error can also be caused by malfunctioning hardware.
We will try our best to scrape up some info that will hopefully help diagnose
the problem, but since we have already crashed, something is definitely wrong
and this may fail.

key_buffer_size=8388600
read_buffer_size=131072
max_used_connections=2
max_connections=100
threads_connected=1
It is possible that mysqld could use up to
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_connections = 225791 K
bytes of memory
Hope that's ok; if not, decrease some variables in the equation.

thd=0x8aa04e8
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
Cannot determine thread, fp=0xbd9fc5a8, backtrace may not be correct.
Stack range sanity check OK, backtrace follows:
0x816e55c
0x400605cd
0x835ee94
0x8227940
0x82264b6
0x8220577
0x820b227
0x8237426
0x8239d38
0x823e964
0x81b140b
0x81b1e35
0x81add1a
0x818187f
0x8187e66
0x8180160
0x817fcbd
0x817f21e
0x4005a6de
0x401da6c7
New value of fp=(nil) failed sanity check, terminating stack trace!
Please read http://dev.mysql.com/doc/mysql/en/Using_stack_trace.html and follow instructions on how to resolve the stack trace. Resolved
stack trace is much more helpful in diagnosing the problem, so please do
resolve it
Trying to get some variables.
Some pointers may be invalid and cause the dump to abort...
thd->query at 0x8a78e38 = show tables
thd->thread_id=1705
The manual page at http://www.mysql.com/doc/en/Crashing.html contains
information that should help you find out what is causing the crash.
050722 16:52:17  InnoDB: Database was not shut down normally!
InnoDB: Starting crash recovery.
InnoDB: Reading tablespace information from the .ibd files...
InnoDB: Restoring possible half-written data pages from the doublewrite
InnoDB: buffer...
050722 16:52:17  InnoDB: Starting log scan based on checkpoint at
InnoDB: log sequence number 0 43655.
InnoDB: Doing recovery: scanned up to log sequence number 0 43655
050722 16:52:17  InnoDB: Started; log sequence number 0 43655
050722 16:52:20 [Note] Starting Cluster Binlog
050722 16:52:20 [Note] Recovering after a crash using /home/ndbdev/jmiller/builds/var/master2050722 16:52:23 [Note] Starting crash recovery...
050722 16:52:23 [Note] Crash recovery finished.
050722 16:52:23 [Note] /home/ndbdev/jmiller/builds/libexec/mysqld: ready for connections.
Version: '5.1.0-a_drop5p3-log'  socket: '/tmp/mysql.sock'  port: 3306  Source distribution
050722 16:52:23 [Note] NDB Binlog: DISCOVER TABLE Event: REPL$cluster_replication/apply_status
050722 16:52:23 [Note] NDB Binlog: replicating REPL$cluster_replication/apply_status.
050722 16:52:23 [Note] NDB Binlog: DISCOVER TABLE Event: REPL$TPCB/account
050722 16:52:24 [Note] NDB Binlog: replicating REPL$TPCB/account.
050722 16:52:24 [Note] NDB Binlog: DISCOVER TABLE Event: REPL$TPCB/branch
050722 16:52:24 [Note] NDB Binlog: replicating REPL$TPCB/branch.
050722 16:52:24 [Note] NDB Binlog: DISCOVER TABLE Event: REPL$TPCB/teller
050722 16:52:24 [Note] NDB Binlog: DISCOVER TABLE Event: REPL$BANK/SYSTEM_VALUES
050722 16:52:24 [Note] NDB Binlog: replicating REPL$TPCB/teller.
050722 16:52:24 [Note] NDB Binlog: replicating REPL$BANK/SYSTEM_VALUES.
050722 16:52:24 [Note] NDB Binlog: DISCOVER TABLE Event: REPL$TPCB/history
050722 16:52:24 [Note] NDB Binlog: DISCOVER TABLE Event: REPL$BANK/ACCOUNT
050722 16:52:24 [Note] NDB Binlog: replicating REPL$TPCB/history.
050722 16:52:24 [Note] NDB: missing frm for test.history, discovering...
050722 16:52:24 [Note] NDB Binlog: replicating REPL$BANK/ACCOUNT.
050722 16:52:24 [Note] NDB Binlog: DISCOVER TABLE Event: REPL$BANK/TRANSACTION
050722 16:52:24 [Note] NDB Binlog: DISCOVER TABLE Event: REPL$test/history
050722 16:52:24 [Note] NDB Binlog: replicating REPL$BANK/TRANSACTION.
050722 16:52:24 [Note] NDB Binlog: DISCOVER TABLE Event: REPL$BANK/ACCOUNT_TYPES
050722 16:52:24 [Note] NDB Binlog: replicating REPL$test/history.
050722 16:52:24 [Note] NDB Binlog: DISCOVER TABLE Event: REPL$BANK/GL
050722 16:52:24 [Note] NDB Binlog: replicating REPL$BANK/ACCOUNT_TYPES.
mysqld got signal 11;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured. This error can also be caused by malfunctioning hardware.
We will try our best to scrape up some info that will hopefully help diagnose
the problem, but since we have already crashed, something is definitely wrong
and this may fail.

key_buffer_size=8388600
read_buffer_size=131072
max_used_connections=1
max_connections=100
threads_connected=1
It is possible that mysqld could use up to
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_connections = 225791 K
bytes of memory
Hope that's ok; if not, decrease some variables in the equation.

thd=0x89bc900
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
Cannot determine thread, fp=0xbdbfe1d8, backtrace may not be correct.
Stack range sanity check OK, backtrace follows:
0x816e55c
0x400605cd
0x8227957
0x82264b6
0x822686e
0x8221edf
0x4005a6de
0x401da6c7
New value of fp=(nil) failed sanity check, terminating stack trace!
Please read http://dev.mysql.com/doc/mysql/en/Using_stack_trace.html and follow instructions on how to resolve the stack trace. Resolved
stack trace is much more helpful in diagnosing the problem, so please do
resolve it
Trying to get some variables.
Some pointers may be invalid and cause the dump to abort...
thd->query at (nil)  is invalid pointer
thd->thread_id=4294967295
The manual page at http://www.mysql.com/doc/en/Crashing.html contains
information that should help you find out what is causing the crash.
050722 16:53:14  InnoDB: Database was not shut down normally!
InnoDB: Starting crash recovery.
InnoDB: Reading tablespace information from the .ibd files...
InnoDB: Restoring possible half-written data pages from the doublewrite
InnoDB: buffer...
050722 16:53:14  InnoDB: Starting log scan based on checkpoint at
InnoDB: log sequence number 0 43655.
InnoDB: Doing recovery: scanned up to log sequence number 0 43655
050722 16:53:14  InnoDB: Started; log sequence number 0 43655
050722 16:53:14 [Note] Starting Cluster Binlog
050722 16:53:14 [Note] Recovering after a crash using /home/ndbdev/jmiller/builds/var/master2050722 16:53:14 [Note] Starting crash recovery...
050722 16:53:14 [Note] Crash recovery finished.
050722 16:53:14 [Note] /home/ndbdev/jmiller/builds/libexec/mysqld: ready for connections.
Version: '5.1.0-a_drop5p3-log'  socket: '/tmp/mysql.sock'  port: 3306  Source distribution
050722 16:53:14 [Note] NDB Binlog: DISCOVER TABLE Event: REPL$cluster_replication/apply_status
050722 16:53:14 [Note] NDB Binlog: replicating REPL$cluster_replication/apply_status.
050722 16:53:14 [Note] NDB Binlog: DISCOVER TABLE Event: REPL$TPCB/account
050722 16:53:14 [Note] NDB Binlog: replicating REPL$TPCB/account.
050722 16:53:14 [Note] NDB Binlog: DISCOVER TABLE Event: REPL$TPCB/branch
050722 16:53:14 [Note] NDB Binlog: replicating REPL$TPCB/branch.
050722 16:53:14 [Note] NDB Binlog: DISCOVER TABLE Event: REPL$TPCB/teller
050722 16:53:14 [Note] NDB Binlog: replicating REPL$TPCB/teller.
050722 16:53:14 [Note] NDB Binlog: DISCOVER TABLE Event: REPL$TPCB/history
050722 16:53:14 [Note] NDB Binlog: replicating REPL$TPCB/history.
050722 16:53:15 [Note] NDB Binlog: DISCOVER TABLE Event: REPL$test/history
050722 16:53:15 [Note] NDB Binlog: replicating REPL$test/history.
050722 16:53:15 [Note] NDB Binlog: DISCOVER TABLE Event: REPL$BANK/GL
050722 16:53:15 [Note] NDB Binlog: replicating REPL$BANK/GL.
050722 16:53:15 [Note] NDB Binlog: DISCOVER TABLE Event: REPL$BANK/ACCOUNT
050722 16:53:15 [Note] NDB Binlog: replicating REPL$BANK/ACCOUNT.
050722 16:53:15 [Note] NDB Binlog: DISCOVER TABLE Event: REPL$BANK/TRANSACTION
050722 16:53:15 [Note] NDB Binlog: replicating REPL$BANK/TRANSACTION.
050722 16:53:15 [Note] NDB Binlog: DISCOVER TABLE Event: REPL$BANK/SYSTEM_VALUES
050722 16:53:15 [Note] NDB Binlog: replicating REPL$BANK/SYSTEM_VALUES.
050722 16:53:15 [Note] NDB Binlog: DISCOVER TABLE Event: REPL$BANK/ACCOUNT_TYPES
050722 16:53:15 [Note] NDB Binlog: replicating REPL$BANK/ACCOUNT_TYPES.

*********************************************************************************************
Trace #1
0x816e55c handle_segfault + 392
0x400605cd _end + 934758425
0x835ee94 _ZNK13NdbDictionary6Column7getNameEv + 8
0x8227940 _Z27ndbcluster_create_event_opsP19st_ndbcluster_sharePKN13NdbDictionary5TableEPKc + 484
0x82264b6 _Z30ndbcluster_create_binlog_setupP3NdbPKcS2_S2_bP19st_ndbcluster_share + 574
0x8220577 _Z21ndbcluster_find_filesP3THDPKcS2_S2_bP4ListIcE + 1571
0x820b227 _Z13ha_find_filesP3THDPKcS2_S2_bP4ListIcE + 51
0x8237426 _Z16mysql_find_filesP3THDP4ListIcEPKcS5_S5_b + 266
0x8239d38 _Z14get_all_tablesP3THDP13st_table_listP4Item + 1656
0x823e964 _Z24get_schema_tables_resultP4JOIN + 324
0x81b140b _ZN4JOIN4execEv + 5731
0x81b1e35 _Z12mysql_selectP3THDPPP4ItemP13st_table_listjR4ListIS1_ES2_jP8st_orderSB_S2_SB_mP13select_resultP18st_select_lex_unitP13st_sel + 393
0x81add1a _Z13handle_selectP3THDP6st_lexP13select_resultm + 234
0x818187f _Z21mysql_execute_commandP3THD + 675
0x8187e66 _Z11mysql_parseP3THDPcj + 266
0x8180160 _Z16dispatch_command19enum_server_commandP3THDPcj + 1128
0x817fcbd _Z10do_commandP3THD + 129
0x817f21e handle_one_connection + 582
0x4005a6de _end + 934734122
0x401da6c7 _end + 936306963
trace# 2
0x816e55c handle_segfault + 392
0x400605cd _end + 934758425
0x8227957 _Z27ndbcluster_create_event_opsP19st_ndbcluster_sharePKN13NdbDictionary5TableEPKc + 507
0x82264b6 _Z30ndbcluster_create_binlog_setupP3NdbPKcS2_S2_bP19st_ndbcluster_share + 574
0x822686e _Z25ndbcluster_find_all_filesP3THD + 634
0x8221edf ndb_util_thread_func + 611
0x4005a6de _end + 934734122
0x401da6c7 _end + 936306963
 

How to repeat:
Master:
3 Mysqld processes on 3 different computers (mysqld#1 (master), mysqld#2 (master failover) and mysqld#3 (master failover))
Slave:
3 Mysqld processes on 3 different computers (mysqld#4 (slave), mysqld#5 (slave failover) and mysqld#3 (slave failover))

I dropped all the databases on mysqld#1. Then issues master reset.
I dropped all the databases on mysqld#4. Then issues slave reset, slave start;
I created all databases using mysqld#1 and they were replicated.

I had not dropped database or done master resets on mysqld#2 or mysqld#3. Instead I did use database X; show tables; both mysqld processes crashed.
[22 Jul 2005 17:13] Jonathan Miller 
Change Synopsis.
[22 Jul 2005 22:16] Jonathan Miller 
New test case:
1) setup cluster with 2 mysqld processes on separate comupters pointing to the same cluster;
2) created database + tables and start a load
3) on the other mysqld created the database and do a show tables to discover the tables and exit.
4) On the first mysqld, drop the database, reset master, and create database + tables.
5) log back into the second and do use database and show tables.

0x8171180 handle_segfault + 392
0x4005e5cd _end + 934697685
0x8364b90 _ZNK13NdbDictionary6Column7getNameEv + 8
0x8228254 _Z27ndbcluster_create_event_opsP19st_ndbcluster_sharePKN13NdbDictionary5TableEPKc + 484
0x8226dca _Z30ndbcluster_create_binlog_setupP3NdbPKcS2_S2_bP19st_ndbcluster_share + 574
0x8220e2b _Z21ndbcluster_find_filesP3THDPKcS2_S2_bP4ListIcE + 1567
0x820b333 _Z13ha_find_filesP3THDPKcS2_S2_bP4ListIcE + 51
0x823811a _Z16mysql_find_filesP3THDP4ListIcEPKcS5_S5_b + 266
0x823aa40 _Z14get_all_tablesP3THDP13st_table_listP4Item + 1656
0x823f908 _Z24get_schema_tables_resultP4JOIN + 324
0x81b0bff _ZN4JOIN4execEv + 5967
0x81b16b3 _Z12mysql_selectP3THDPPP4ItemP13st_table_listjR4ListIS1_ES2_jP8st_orderSB_S2_SB_mP13select_resultP18st_select_lex_unitP13st_sel + 283
0x81ad41a _Z13handle_selectP3THDP6st_lexP13select_resultm + 234
0x8184709 _Z21mysql_execute_commandP3THD + 737
0x818af1e _Z11mysql_parseP3THDPcj + 266
0x8182fa4 _Z16dispatch_command19enum_server_commandP3THDPcj + 1128
0x8182b01 _Z10do_commandP3THD + 129
0x8182062 handle_one_connection + 582
0x400586de _end + 934673382
0x401d86c7 _end + 936246223
[22 Jul 2005 23:53] Tomas Ulin 
simpler test case:

connect to server1
create table t1 (a int primary key, b int) engine=ndb;

connect to server2
show tables;

connect to server1
drop table t1;
create table t1 (a int primary key, b int) engine=ndb;

connect to server2
show tables;
... boom
[23 Jul 2005 14:15] Bugs System 
A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/internals/27522
[23 Jul 2005 14:15] Tomas Ulin 
no need to document as it has not been released
[25 Jul 2005 19:16] Jonathan Miller 
Sill happens in current clone: mysql-5.1-wl2325-a
[25 Jul 2005 19:18] Jonathan Miller 
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
Cannot determine thread, fp=0xbd7fc5a8, backtrace may not be correct.
Stack range sanity check OK, backtrace follows:
0x8171180
0x4005e5cd
0x8364b90
0x8228254
0x8226dca
0x8220e2b
0x820b333
0x823811a
0x823aa40
0x823f908
0x81b0bff
0x81b16b3
0x81ad41a
0x8184709
0x818af1e
0x8182fa4
0x8182b01
0x8182062
0x400586de
0x401d86c7
[25 Jul 2005 21:26] Jonathan Miller 
My mistake, missed picking up Tomas patch entered Saturday.