Bug #25237 SELECT causes data node crash
Submitted: 21 Dec 2006 16:03 Modified: 10 Oct 2007 7:59
Reporter: Victoria Reznichenko Email Updates:
Status: Can't repeat Impact on me:
None 
Category:MySQL Cluster: Cluster (NDB) storage engine Severity:S1 (Critical)
Version:5.0.34bk OS:Linux (SuSe)
Assigned to: Martin Skold CPU Architecture:Any

[21 Dec 2006 16:03] Victoria Reznichenko
Description:
SELECT crashed data node:

2006-12-21 18:34:31 [MgmSrvr] ALERT    -- Node 2: Node 3 Disconnected
2006-12-21 18:34:31 [MgmSrvr] INFO     -- Node 2: Communication to Node 3 closed
2006-12-21 18:34:31 [MgmSrvr] ALERT    -- Node 2: Network partitioning - arbitration required
2006-12-21 18:34:31 [MgmSrvr] INFO     -- Node 2: President restarts arbitration thread [state=7]
2006-12-21 18:34:31 [MgmSrvr] INFO     -- Node 1: Node 3 Connected
2006-12-21 18:34:31 [MgmSrvr] ALERT    -- Node 3: Forced node shutdown completed. Initiated by signal 6. Caused by error 2301: 'Assertion(Internal error, programming error or missing error message, please report a bug). Temporary error, restart node'.
2006-12-21 18:34:32 [MgmSrvr] ALERT    -- Node 2: Arbitration won - positive reply from node 1
2006-12-21 18:34:32 [MgmSrvr] INFO     -- Node 2: DICT: lock bs: 0 ops: 0 poll: 0 cnt: 0 queue:
2006-12-21 18:34:32 [MgmSrvr] INFO     -- Node 2: Started arbitrator node 1 [ticket=14640002a5a63ba1]
2006-12-21 18:34:35 [MgmSrvr] INFO     -- Node 2: Communication to Node 3 opened

from data node error log:

Time: Thursday 21 December 2006 - 18:34:30
Status: Temporary error, restart node
Message: Assertion (Internal error, programming error or missing error message, please report a bug)
Error: 2301
Error data: ArrayPool<T>::getPtr
Error object: ../../../../../ndb/src/kernel/vm/ArrayPool.hpp line: 355 (block: DBTC)
Program: ./libexec/ndbd
Pid: 5256
Trace: /var/lib/vita/nodeb/ndb_3_trace.log.1
Version: Version 5.0.34
***EOM***

How to repeat:
- tables.zip contains dump of 2 tables
- ndb_error_report_20061221185726.tar.bz2

1. Restore tables
2. Run SELECT query listed below
[21 Dec 2006 16:04] MySQL Verification Team
logs and trace files

Attachment: ndb_error_report_20061221185726.tar.bz2 (application/bzip2, text), 714 bytes.

[27 Dec 2006 12:41] MySQL Verification Team
logs and trace

Attachment: bug25237_logs_trace.zip (application/zip, text), 45.61 KiB.

[16 May 2007 9:45] Martin Skold
The problem seems to be resource shortage that is not handled properly.
Increasing TransactionBufferMemory (1M by default) should solve the problem.
The bug fix will be that the transaction is aborted with an error message
telling the user that this parameter needs to be increased.