MySQL Bugs: #54888: error 2341 after restart

Bug #54888	error 2341 after restart
Submitted:	29 Jun 2010 8:47	Modified:	6 Aug 2010 8:48
Reporter:	sebastien wachter	Email Updates:
Status:	No Feedback	Impact on me:	None
Category:	MySQL Cluster: Cluster (NDB) storage engine	Severity:	S2 (Serious)
Version:	ndb-6.3.24-GA	OS:	Linux
Assigned to:		CPU Architecture:	Any

Description:
after stop node with ndb_mgm
3 stop 
when restart this node 
now we have this message 

[ndb_3_error.log]

Time: Tuesday 29 June 2010 - 07:50:24
Status: Temporary error, restart node
Message: Internal program error (failed ndbrequire) (Internal error, programming error or missing error message, please report a bug)
Error: 2341
Error data: dbdict/Dbdict.cpp
Error object: DBDICT (Line: 3171) 0x0000000a
Program: /usr/bin/ndbd
Pid: 2636
Trace: /var/lib/mysql-cluster/ndb_3_trace.log.17
Version: mysql-5.1.32 ndb-6.3.24-GA

[nbd_3_out.log]

010-06-29 07:36:13 [ndbd] INFO     -- Angel pid: 2634 ndb pid: 2636                                     
2010-06-29 07:36:13 [ndbd] INFO     -- NDB Cluster -- DB node 3                                          
2010-06-29 07:36:13 [ndbd] INFO     -- mysql-5.1.32 ndb-6.3.24-GA --                                     
2010-06-29 07:36:13 [ndbd] INFO     -- Configuration fetched at 172.30.210.252 port 1186                 
2010-06-29 07:36:13 [ndbd] INFO     -- Start initiated (mysql-5.1.32 ndb-6.3.24)                         
NDBFS/AsyncFile: Allocating 310392 for In/Deflate buffer                                                 
NDBFS/AsyncFile: Allocating 310392 for In/Deflate buffer                                                 
NDBFS/AsyncFile: Allocating 310392 for In/Deflate buffer
NDBFS/AsyncFile: Allocating 310392 for In/Deflate buffer
NDBFS/AsyncFile: Allocating 310392 for In/Deflate buffer
NDBFS/AsyncFile: Allocating 310392 for In/Deflate buffer
NDBFS/AsyncFile: Allocating 310392 for In/Deflate buffer
NDBFS/AsyncFile: Allocating 310392 for In/Deflate buffer
NDBFS/AsyncFile: Allocating 310392 for In/Deflate buffer
NDBFS/AsyncFile: Allocating 310392 for In/Deflate buffer
NDBFS/AsyncFile: Allocating 310392 for In/Deflate buffer
NDBFS/AsyncFile: Allocating 310392 for In/Deflate buffer
NDBFS/AsyncFile: Allocating 310392 for In/Deflate buffer
NDBFS/AsyncFile: Allocating 310392 for In/Deflate buffer
NDBFS/AsyncFile: Allocating 310392 for In/Deflate buffer
NDBFS/AsyncFile: Allocating 310392 for In/Deflate buffer
NDBFS/AsyncFile: Allocating 310392 for In/Deflate buffer
NDBFS/AsyncFile: Allocating 310392 for In/Deflate buffer
NDBFS/AsyncFile: Allocating 310392 for In/Deflate buffer
NDBFS/AsyncFile: Allocating 310392 for In/Deflate buffer
NDBFS/AsyncFile: Allocating 310392 for In/Deflate buffer
NDBFS/AsyncFile: Allocating 310392 for In/Deflate buffer
NDBFS/AsyncFile: Allocating 310392 for In/Deflate buffer
NDBFS/AsyncFile: Allocating 310392 for In/Deflate buffer
NDBFS/AsyncFile: Allocating 310392 for In/Deflate buffer
NDBFS/AsyncFile: Allocating 310392 for In/Deflate buffer
NDBFS/AsyncFile: Allocating 310392 for In/Deflate buffer
2010-06-29 07:36:13 [ndbd] INFO     -- Ndbd_mem_manager::init(1) min: 10240Mb initial: 10260Mb
Adding 8192Mb to ZONE_LO (1,262142)
Adding 2068Mb to ZONE_LO (262145,66175)
WOPool::init(61, 9)
RWPool::init(22, 13)
RWPool::init(42, 18)
RWPool::init(62, 13)
RWPool::init(c2, 18)
RWPool::init(e2, 18)
WOPool::init(41, 12)
RWPool::init(82, 12)
RWPool::init(a2, 52)
WOPool::init(21, 10)
2010-06-29 07:50:24 [ndbd] INFO     -- dbdict/Dbdict.cpp
2010-06-29 07:50:24 [ndbd] INFO     -- DBDICT (Line: 3171) 0x0000000a
2010-06-29 07:50:24 [ndbd] INFO     -- Error handler startup shutting down system
2010-06-29 07:50:24 [ndbd] INFO     -- Error handler shutdown completed - exiting
2010-06-29 07:50:24 [ndbd] INFO     -- Angel received ndbd startup failure count 1.
2010-06-29 07:50:24 [ndbd] ALERT    -- Node 3: Forced node shutdown completed. Occured during startphase5. Caused by error 2341: 'Internal program error (failed ndbrequire)(Internal error, programming error or missing error message, please report a bug). Temporary error, restart node'.

[CONFIG.INI]

[NDBD DEFAULT]                                          
NoOfReplicas=2                                          
#4G                                                     
DataMemory=10G                                          
IndexMemory=1750M                                       
FragmentLogFileSize=256M                                
NoOfFragmentLogFiles=83                                 
UndoIndexBuffer=32M                                     
RedoBuffer=32M                                          
MaxNoOfConcurrentOperations=1000000                     
TimeBetweenLocalCheckpoints=31                          
MaxNoOfTables=4096                                      
MaxNoOfAttributes=24756                                 
MaxNoOfOrderedIndexes=4096                              
MaxNoOfUniqueHashIndexes=1024                           
[MYSQLD DEFAULT]                                        
[NDB_MGMD DEFAULT]                                      
PortNumber=1186                                         
LogDestination=CONSOLE;SYSLOG:facility=syslog;FILE:filename=/var/log/cluster-log
DataDir=/var/lib/mysql-cluster                                                  
ArbitrationRank=1                                                               
[TCP DEFAULT]                                                                   
SendBufferMemory=1024K                                                          
ReceiveBufferMemory=256K                                                        

# Section for the cluster management node
[NDB_MGMD]                               
# IP address of the management node (this system)
id=1                                             
HostName=172.30.210.252                          
PortNumber=1186
LogDestination=CONSOLE;SYSLOG:facility=syslog;FILE:filename=/var/log/cluster-log
DataDir=/var/lib/mysql-cluster
ArbitrationRank=1
#HostName=mgmt.netasq.com
# Section for the storage nodes
[NDBD]
# IP address of the first storage node
id=2
HostName=172.30.210.220
DataDir= /var/lib/mysql-cluster
[NDBD]
# IP address of the second storage node
id=3
HostName=172.30.210.221
DataDir=/var/lib/mysql-cluster
[MYSQLD]
id=10
HostName=172.30.210.220
[MYSQLD]
id=11
HostName=172.30.210.221

i have try ndbd --initial , but i have the same error when restart

have you an idea to fix it ? 

How to repeat:

restart the node

Suggested fix:
no idea

Hi,

I have not analyzed the (not yet? uploaded logs).
But I think you should try to upgrade.

/Jonas

No feedback was provided for this bug for over a month, so it is
being suspended automatically. If you are able to provide the
information that was originally requested, please do so and change
the status of the bug back to "Open".