Bug #24146 Connect to server fails in run with NDB, timeout 400 s for "apply_status.ndb"
Submitted: 9 Nov 2006 16:01 Modified: 5 Apr 2007 14:27
Reporter: Joerg Bruehe Email Updates:
Status: Closed Impact on me:
None 
Category:MySQL Cluster: Cluster (NDB) storage engine Severity:S1 (Critical)
Version:5.1.12-beta OS:MacOS (OS-X 10.4 PPC 64bit)
Assigned to: CPU Architecture:Any

[9 Nov 2006 16:01] Joerg Bruehe
Description:
New effect in 5.1.12-beta, no previous logs with this symptom found
(hope that is no consequence of too eager cleanup):

ndb_alter_table2               [ fail ]

Errors are (from /PATH/mysqltest-time) :
mysqltest: Could not open connection 'default': 2002 Can't connect to local MySQL server through socket '/PATH/master.sock'
 (2)
(the last lines may be the most important ones)

Stopping All Servers
Shutting-down Instance Manager
Restoring snapshot of databases
Resuming Tests

After this, there is a 400 s timeout, indicated by messages like this:

mysql-test-run: WARNING: Waited 60 seconds for /Users/mysqldev/osx-tiger-ppc-64bit/test/mysql-5.1.12-beta-osx10.4-powerpc-64bit/mysql-test/var/master-data/cluster/apply_status.ndb to be created, still waiting for 340 seconds...

These are given with the times 60 (340), 60.1 (339.9) .. 60.9 (339.1),
then similar groups starting at 120, 180, 240, 300, 360 seconds,
the last line with times 360.9 (39.1) seconds.

This occurs in 85 tests, when running "ps+rowrepl+NDB".
In 22 of these, it also occurs when just running "NDB".
It is specific to "osx-tiger-ppc-64bit".

List of all 85 tests:
ndb_alter_table2 ndb_alter_table3 ndb_alter_table ndbapi ndb_basic
ndb_binlog_basic2 ndb_binlog_basic ndb_binlog_ddl_multi ndb_binlog_ignore_db
ndb_binlog_multi ndb_bitfield ndb_blob ndb_blob_partition ndb_cache2
ndb_cache ndb_cache_multi2 ndb_cache_multi ndb_charset
ndb_condition_pushdown ndb_config2 ndb_config ndb_database
ndb_dd_alter ndb_dd_backuprestore ndb_dd_basic ndb_dd_ddl ndb_dd_disk2memory
ndb_dd_dump ndb_dd_sql_features ndb_gis 
ndb_index ndb_index_ordered ndb_index_unique ndb_insert ndb_limit
ndb_loaddatalocal ndb_lock ndb_minmax ndb_multi ndb_multi_row 
ndb_partition_error ndb_partition_key ndb_partition_list ndb_partition_range
ndb_read_multi_range ndb_rename ndb_replace ndb_restore ndb_restore_compat
ndb_restore_partition ndb_subquery ndb_temporary ndb_transaction
ndb_trigger ndb_truncate ndb_types ndb_update ndb_view 
rpl_ndbapi_multi rpl_ndb_auto_inc rpl_ndb_basic rpl_ndb_blob2 rpl_ndb_blob
rpl_ndb_charset rpl_ndb_commit_afterflush rpl_ndb_dd_advance rpl_ndb_dd_basic
rpl_ndb_delete_nowhere rpl_ndb_func003 rpl_ndb_idempotent rpl_ndb_innodb_trans
rpl_ndb_insert_ignore rpl_ndb_log rpl_ndb_multi rpl_ndb_multi_update2
rpl_ndb_multi_update3 rpl_ndb_row_001 rpl_ndb_sp003 rpl_ndb_sp006
rpl_ndb_sync rpl_ndb_trig004 rpl_ndb_UUID rpl_row_basic_7ndb
rpl_truncate_7ndb strict_autoinc_5ndb

*After* this "ps+rowrepl+NDB" run there is a "NDB" run (all others = default).
In this, the first two passed (ndb_alter_table + ndb_alter_table2),
then a different failure (below),
then 22 failures as described above,
then test suite timeout.

ndb_alter_table3               [ fail ]

Errors are (from /Users/mysqldev/osx-tiger-ppc-64bit/test/mysql-5.1.12-beta-osx10.4-powerpc-64bit/mysql-test/var/log/mysqltest-time) :
mysqltest: At line 30: query 'insert into t3 values (1)' failed: 1036: Table 't3' is read only
(the last lines may be the most important ones)
Result from queries before failure can be found in r/ndb_alter_table3.log

How to repeat:
Found when running the test suite.