Bug #31690 Online Upgrading to CGE 6.2.6/7 and 6.3.4 failing
Submitted: 18 Oct 2007 14:34 Modified: 2 Jul 2008 20:35
Reporter: Geert Vanderkelen
Status: Closed
Category:Server: Cluster Severity:S2 (Serious)
Version:5.1.22_6.2.6,5.1.22_6.2.7,5.1.22_6.3.4, OS:Any
Assigned to: Target Version:
Tags: cluster, cge, upgrade
Triage: D2 (Serious)

[18 Oct 2007 14:34] Geert Vanderkelen 
Description:
Following online upgrades are:

.. not working
CGE 5.1.15_6.1.21 -> 5.1.22_6.2.7
CGE 5.1.15_6.1.21 -> 5.1.22_6.2.6
CGE 5.1.22_6.3.3 -> 5.1.22_6.3.4

.. working:
CGE 5.1.22_6.2.6 -> 5.1.22_6.2.7 : this is working

In all cases where it is not working the ndb_mgmd, after restarting it into the new
version behaves abnormal. Restarting an ndbd in that case will lead to an
ArbitrationError.

How to repeat:
- Setup a cluster version 6.3.3
- Start online upgrade, thus stopping the management server of 6.3.3 and start the
6.3.4.
- Observe in the cluster log what happens:

2007-10-17 13:58:09 [MgmSrvr] INFO -- NDB Cluster Management Server. mysql-5.1.22
ndb-6.3.4-beta
2007-10-17 13:58:09 [MgmSrvr] INFO -- Id: 1, Command port: *:1406
2007-10-17 13:58:09 [MgmSrvr] INFO -- Node 1: Node 4 Connected
2007-10-17 13:58:09 [MgmSrvr] INFO -- Node 1: Node 3 Connected
2007-10-17 13:58:09 [MgmSrvr] INFO -- Node 3: Started arbitrator node 1
[ticket=7f7d0002add35d76]
2007-10-17 13:58:13 [MgmSrvr] WARNING -- Node 3: Node 1 missed heartbeat 2
2007-10-17 13:58:13 [MgmSrvr] WARNING -- Node 4: Node 1 missed heartbeat 2
2007-10-17 13:58:15 [MgmSrvr] WARNING -- Node 3: Node 1 missed heartbeat 3
2007-10-17 13:58:15 [MgmSrvr] WARNING -- Node 4: Node 1 missed heartbeat 3
2007-10-17 13:58:16 [MgmSrvr] ALERT -- Node 1: Node 4 Disconnected
2007-10-17 13:58:16 [MgmSrvr] ALERT -- Node 1: Node 3 Disconnected
2007-10-17 13:58:20 [MgmSrvr] INFO -- Node 1: Node 4 Connected
2007-10-17 13:58:20 [MgmSrvr] INFO -- Node 1: Node 3 Connected
2007-10-17 13:58:21 [MgmSrvr] INFO -- Node 4: Prepare arbitrator node 1
[ticket=7f7d0003add3f604]
2007-10-17 13:58:24 [MgmSrvr] WARNING -- Node 4: Node 1 missed heartbeat 2
2007-10-17 13:58:25 [MgmSrvr] WARNING -- Node 3: Node 1 missed heartbeat 2
2007-10-17 13:58:25 [MgmSrvr] WARNING -- Node 4: Node 1 missed heartbeat 3
2007-10-17 13:58:27 [MgmSrvr] WARNING -- Node 3: Node 1 missed heartbeat 3
2007-10-17 13:58:27 [MgmSrvr] ALERT -- Node 1: Node 4 Disconnected
2007-10-17 13:58:27 [MgmSrvr] ALERT -- Node 1: Node 3 Disconnected
2007-10-17 13:58:30 [MgmSrvr] INFO -- Node 1: Node 4 Connected
2007-10-17 13:58:30 [MgmSrvr] INFO -- Node 1: Node 3 Connected
2007-10-17 13:58:31 [MgmSrvr] INFO -- Node 4: Prepare arbitrator node 1
[ticket=7f7d0004add41ff2]

Suggested fix:
- document
- should work for next versions?
[30 Oct 2007 12:55] Bugs System 
A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/commits/36640

ChangeSet@1.2680, 2007-10-30 12:58:10+01:00, tomas@whalegate.ndb.mysql.com +1 -0
  Bug #31690  	Online Upgrading to CGE 6.2.6/7 and 6.3.4 failing
  - 6.1->6.2 part
[5 Nov 2007 14:53] Bugs System 
Pushed into 6.0.4-alpha
[6 Nov 2007 15:50] Bugs System 
A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/commits/37189

ChangeSet@1.2717, 2007-11-06 15:53:44+01:00, tomas@whalegate.ndb.mysql.com +1 -0
  Bug #31690 - Online Upgrading to CGE 6.2.6/7 and 6.3.4 failing
[8 Nov 2007 13:53] Jon Stephens 
Documented fix in 5.1.22-ndb-6.3.6 and 6.0.4 changelogs. Left in PP status.
[8 Nov 2007 14:35] Jon Stephens 
Fix also documented for 5.1.22-ndb-6.2.8; status unchanged.
[2 Jul 2008 20:35] Jon Stephens 
No need to document for 5.1-main. Closed.