Bug #31690 Online Upgrading to CGE 6.2.6/7 and 6.3.4 failing
Submitted: 18 Oct 2007 12:34 Modified: 2 Jul 2008 18:35
Reporter: Geert Vanderkelen Email Updates:
Status: Closed Impact on me:
None 
Category:MySQL Cluster: Cluster (NDB) storage engine Severity:S2 (Serious)
Version:5.1.22_6.2.6,5.1.22_6.2.7,5.1.22_6.3.4, OS:Any
Assigned to: CPU Architecture:Any
Tags: cge, cluster, upgrade

[18 Oct 2007 12:34] Geert Vanderkelen
Description:
Following online upgrades are:

.. not working
CGE 5.1.15_6.1.21 -> 5.1.22_6.2.7
CGE 5.1.15_6.1.21 -> 5.1.22_6.2.6
CGE 5.1.22_6.3.3 -> 5.1.22_6.3.4

.. working:
CGE 5.1.22_6.2.6 -> 5.1.22_6.2.7 : this is working

In all cases where it is not working the ndb_mgmd, after restarting it into the new version behaves abnormal. Restarting an ndbd in that case will lead to an ArbitrationError.

How to repeat:
- Setup a cluster version 6.3.3
- Start online upgrade, thus stopping the management server of 6.3.3 and start the 6.3.4.
- Observe in the cluster log what happens:

2007-10-17 13:58:09 [MgmSrvr] INFO -- NDB Cluster Management Server. mysql-5.1.22 ndb-6.3.4-beta
2007-10-17 13:58:09 [MgmSrvr] INFO -- Id: 1, Command port: *:1406
2007-10-17 13:58:09 [MgmSrvr] INFO -- Node 1: Node 4 Connected
2007-10-17 13:58:09 [MgmSrvr] INFO -- Node 1: Node 3 Connected
2007-10-17 13:58:09 [MgmSrvr] INFO -- Node 3: Started arbitrator node 1 [ticket=7f7d0002add35d76]
2007-10-17 13:58:13 [MgmSrvr] WARNING -- Node 3: Node 1 missed heartbeat 2
2007-10-17 13:58:13 [MgmSrvr] WARNING -- Node 4: Node 1 missed heartbeat 2
2007-10-17 13:58:15 [MgmSrvr] WARNING -- Node 3: Node 1 missed heartbeat 3
2007-10-17 13:58:15 [MgmSrvr] WARNING -- Node 4: Node 1 missed heartbeat 3
2007-10-17 13:58:16 [MgmSrvr] ALERT -- Node 1: Node 4 Disconnected
2007-10-17 13:58:16 [MgmSrvr] ALERT -- Node 1: Node 3 Disconnected
2007-10-17 13:58:20 [MgmSrvr] INFO -- Node 1: Node 4 Connected
2007-10-17 13:58:20 [MgmSrvr] INFO -- Node 1: Node 3 Connected
2007-10-17 13:58:21 [MgmSrvr] INFO -- Node 4: Prepare arbitrator node 1 [ticket=7f7d0003add3f604]
2007-10-17 13:58:24 [MgmSrvr] WARNING -- Node 4: Node 1 missed heartbeat 2
2007-10-17 13:58:25 [MgmSrvr] WARNING -- Node 3: Node 1 missed heartbeat 2
2007-10-17 13:58:25 [MgmSrvr] WARNING -- Node 4: Node 1 missed heartbeat 3
2007-10-17 13:58:27 [MgmSrvr] WARNING -- Node 3: Node 1 missed heartbeat 3
2007-10-17 13:58:27 [MgmSrvr] ALERT -- Node 1: Node 4 Disconnected
2007-10-17 13:58:27 [MgmSrvr] ALERT -- Node 1: Node 3 Disconnected
2007-10-17 13:58:30 [MgmSrvr] INFO -- Node 1: Node 4 Connected
2007-10-17 13:58:30 [MgmSrvr] INFO -- Node 1: Node 3 Connected
2007-10-17 13:58:31 [MgmSrvr] INFO -- Node 4: Prepare arbitrator node 1 [ticket=7f7d0004add41ff2]

Suggested fix:
- document
- should work for next versions?
[30 Oct 2007 11:55] Bugs System
A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/commits/36640

ChangeSet@1.2680, 2007-10-30 12:58:10+01:00, tomas@whalegate.ndb.mysql.com +1 -0
  Bug #31690  	Online Upgrading to CGE 6.2.6/7 and 6.3.4 failing
  - 6.1->6.2 part
[5 Nov 2007 13:53] Bugs System
Pushed into 6.0.4-alpha
[6 Nov 2007 14:50] Bugs System
A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/commits/37189

ChangeSet@1.2717, 2007-11-06 15:53:44+01:00, tomas@whalegate.ndb.mysql.com +1 -0
  Bug #31690 - Online Upgrading to CGE 6.2.6/7 and 6.3.4 failing
[8 Nov 2007 12:53] Jon Stephens
Documented fix in 5.1.22-ndb-6.3.6 and 6.0.4 changelogs. Left in PP status.
[8 Nov 2007 13:35] Jon Stephens
Fix also documented for 5.1.22-ndb-6.2.8; status unchanged.
[2 Jul 2008 18:35] Jon Stephens
No need to document for 5.1-main. Closed.