Bug #44589 Error: 2341 on NDB node Shuts down cluster
Submitted: 30 Apr 2009 21:50 Modified: 1 May 2009 0:27
Reporter: Ari Cooperman Email Updates:
Status: Duplicate Impact on me:
None 
Category:MySQL Cluster: Cluster (NDB) storage engine Severity:S2 (Serious)
Version:mysql-5.1.32 ndb-7.0.5-beta OS:Linux (RedHat ES 4)
Assigned to: Assigned Account CPU Architecture:Any

[30 Apr 2009 21:50] Ari Cooperman
Description:
4 NDB (ndbmtd) node, 1 MDM and 1 mysqld cluster, doing batch inserts under decently heavy load from 10 clients. MGM console shows:

ndb_mgm> Node 4: Forced node shutdown completed. Caused by error 2341: 'Internal program error (failed ndbrequire)(Internal error, programming error or missing error message, please report a bug). Temporary error, restart node'.
Node 2: Forced node shutdown completed. Caused by error 2305: 'Node lost connection to other nodes and can not form a unpartitioned cluster, please investigate if there are error(s) on other node(s)(Arbitration error). Temporary error, restart node'.
Node 3: Forced node shutdown completed. Caused by error 2305: 'Node lost connection to other nodes and can not form a unpartitioned cluster, please investigate if there are error(s) on other node(s)(Arbitration error). Temporary error, restart node'.
Node 5: Forced node shutdown completed. Caused by error 2305: 'Node lost connection to other nodes and can not form a unpartitioned cluster, please investigate if there are error(s) on other node(s)(Arbitration error). Temporary error, restart node'.

The error log of the node that failed shows:

Version: mysql-5.1.32 nd
Time: Thursday 30 April 2009 - 17:15:35
Status: Temporary error, restart node
Message: Internal program error (failed ndbrequire) (Internal error, programming error or missing erro
r message, please report a bug)
Error: 2341
Error data: SimulatedBlock.cpp
Error object: DBTC (Line: 501) 0x0000000a

Trace logs attached

How to repeat:
Start up same configuration and send high insert load via JDBC
[1 May 2009 0:27] Jonas Oreland
#44590
[6 May 2009 9:14] Hartmut Holzgraefe
Duplicate of Bug #44590 (submitted twice)