Bug #17145 Cluster nodes shutdown when 1 node gets killed off
Submitted: 5 Feb 2006 23:04 Modified: 6 Mar 2006 9:03
Reporter: W G Email Updates:
Status: No Feedback Impact on me:
None 
Category:MySQL Cluster: Cluster (NDB) storage engine Severity:S2 (Serious)
Version:5.0.18 OS:Linux (Linux 2.6)
Assigned to: CPU Architecture:Any

[5 Feb 2006 23:04] W G 
Description:
I have 6 data nodes, 1 separate management node and 6 mysqld nodes. 
NoOfReplicas is set to 3 

- All nodes are live 
- I kill an ndb process on one of the nodes 
- As a result, the management node shows : 
Node 2: Forced node shutdown completed. Occured during startphase 5. Initiated by signal 0. Caused by error 2308: 'Another node failed during system restart, please investigate error(s) on other node(s)(Restart error). Temporary error, restart node'. 
Node 5: Forced node shutdown completed. Occured during startphase 5. Initiated by signal 0. Caused by error 2308: 'Another node failed during system restart, please investigate error(s) on other node(s)(Restart error). Temporary error, restart node'. 
Node 6: Forced node shutdown completed. Occured during startphase 5. Initiated by signal 0. Caused by error 2305: 'Arbitrator shutdown, please investigate error(s) on other node(s)(Arbitration error). Temporary error, restart node'. 
show 
Node 3: Forced node shutdown completed. Occured during startphase 5. Initiated by signal 0. Caused by error 2305: 'Arbitrator shutdown, please investigate error(s) on other node(s)(Arbitration error). Temporary error, restart node'. 
Node 7: Forced node shutdown completed. Occured during startphase 5. Initiated by signal 0. Caused by error 2305: 'Arbitrator shutdown, please investigate error(s) on other node(s)(Arbitration error). Temporary error, restart node'. 
- The nodes' logs shows : 
2006-02-01 23:55:05 [ndbd] ALERT -- Node 3: Forced node shutdown completed. Occured during startphase 5. Initiated by signal 0. Caused by error 2305: 'Arbitrator shutdown, please investigate error(s) on other node(s)(Arbitration error). Temporary error, restart node'. 

Since all nodes are now offline, the whole cluster is unavailable. 

How to repeat:
See description
[6 Feb 2006 9:03] Valeriy Kravchuk 
Thank you for a problem report. Looks similar to bug #16308 already reported. Please, check.
[7 Mar 2006 0:00] Bugs System 
No feedback was provided for this bug for over a month, so it is
being suspended automatically. If you are able to provide the
information that was originally requested, please do so and change
the status of the bug back to "Open".