2006-07-03 11:37:20 [MgmSrvr] INFO -- Node 2: Local checkpoint 682 started. Keep GCI = 1097208 oldest restorable GCI = 1097186 2006-07-03 11:40:15 [MgmSrvr] WARNING -- Node 2: Node 8 missed heartbeat 2 2006-07-03 11:40:15 [MgmSrvr] WARNING -- Node 2: Node 10 missed heartbeat 2 2006-07-03 11:40:15 [MgmSrvr] WARNING -- Node 4: Node 6 missed heartbeat 2 2006-07-03 11:40:15 [MgmSrvr] WARNING -- Node 4: Node 8 missed heartbeat 2 2006-07-03 11:40:16 [MgmSrvr] WARNING -- Node 3: Node 6 missed heartbeat 2 2006-07-03 11:40:16 [MgmSrvr] WARNING -- Node 2: Node 6 missed heartbeat 2 2006-07-03 11:40:16 [MgmSrvr] WARNING -- Node 2: Node 12 missed heartbeat 2 2006-07-03 12:33:50 [MgmSrvr] INFO -- Node 2: Local checkpoint 683 started. Keep GCI = 1098803 oldest restorable GCI = 1098808 2006-07-03 13:29:52 [MgmSrvr] INFO -- Node 2: Local checkpoint 684 started. Keep GCI = 1100412 oldest restorable GCI = 1100414 2006-07-03 14:25:57 [MgmSrvr] INFO -- Node 2: Local checkpoint 685 started. Keep GCI = 1102005 oldest restorable GCI = 1102008 2006-07-03 15:22:17 [MgmSrvr] INFO -- Node 2: Local checkpoint 686 started. Keep GCI = 1103602 oldest restorable GCI = 1103560 2006-07-03 16:18:47 [MgmSrvr] INFO -- Node 2: Local checkpoint 687 started. Keep GCI = 1105204 oldest restorable GCI = 1105207 2006-07-03 17:15:32 [MgmSrvr] INFO -- Node 2: Local checkpoint 688 started. Keep GCI = 1106810 oldest restorable GCI = 1106742 2006-07-03 18:12:27 [MgmSrvr] INFO -- Node 2: Local checkpoint 689 started. Keep GCI = 1108423 oldest restorable GCI = 1108378 2006-07-03 19:09:26 [MgmSrvr] INFO -- Node 2: Local checkpoint 690 started. Keep GCI = 1110044 oldest restorable GCI = 1110043 2006-07-03 20:06:24 [MgmSrvr] INFO -- Node 2: Local checkpoint 691 started. Keep GCI = 1111667 oldest restorable GCI = 1111635 2006-07-03 21:03:14 [MgmSrvr] INFO -- Node 2: Local checkpoint 692 started. Keep GCI = 1113288 oldest restorable GCI = 1113218 2006-07-03 22:00:00 [MgmSrvr] INFO -- Node 2: Local checkpoint 693 started. Keep GCI = 1114907 oldest restorable GCI = 1114883 2006-07-03 22:56:59 [MgmSrvr] INFO -- Node 2: Local checkpoint 694 started. Keep GCI = 1116524 oldest restorable GCI = 1116497 2006-07-03 23:53:57 [MgmSrvr] INFO -- Node 2: Local checkpoint 695 started. Keep GCI = 1118147 oldest restorable GCI = 1118106 2006-07-04 00:50:57 [MgmSrvr] INFO -- Node 2: Local checkpoint 696 started. Keep GCI = 1119770 oldest restorable GCI = 1119770 2006-07-04 01:47:57 [MgmSrvr] INFO -- Node 2: Local checkpoint 697 started. Keep GCI = 1121396 oldest restorable GCI = 1121195 2006-07-04 02:44:53 [MgmSrvr] INFO -- Node 2: Local checkpoint 698 started. Keep GCI = 1123021 oldest restorable GCI = 1122906 2006-07-04 03:41:55 [MgmSrvr] INFO -- Node 2: Local checkpoint 699 started. Keep GCI = 1124645 oldest restorable GCI = 1124618 2006-07-04 04:38:56 [MgmSrvr] INFO -- Node 2: Local checkpoint 700 started. Keep GCI = 1126269 oldest restorable GCI = 1126058 2006-07-04 05:35:54 [MgmSrvr] INFO -- Node 2: Local checkpoint 701 started. Keep GCI = 1127894 oldest restorable GCI = 1127767 2006-07-04 06:32:49 [MgmSrvr] INFO -- Node 2: Local checkpoint 702 started. Keep GCI = 1129515 oldest restorable GCI = 1129459 2006-07-04 07:29:17 [MgmSrvr] INFO -- Node 2: Local checkpoint 703 started. Keep GCI = 1131135 oldest restorable GCI = 1131124 2006-07-04 08:25:26 [MgmSrvr] INFO -- Node 2: Local checkpoint 704 started. Keep GCI = 1132742 oldest restorable GCI = 1132704 2006-07-04 09:21:40 [MgmSrvr] INFO -- Node 2: Local checkpoint 705 started. Keep GCI = 1134340 oldest restorable GCI = 1134324 2006-07-04 10:17:54 [MgmSrvr] INFO -- Node 2: Local checkpoint 706 started. Keep GCI = 1135935 oldest restorable GCI = 1135923 2006-07-04 11:14:29 [MgmSrvr] INFO -- Node 2: Local checkpoint 707 started. Keep GCI = 1137532 oldest restorable GCI = 1137527 2006-07-04 11:44:49 [MgmSrvr] WARNING -- Node 4: Node 7 missed heartbeat 2 2006-07-04 11:44:49 [MgmSrvr] WARNING -- Node 3: Node 7 missed heartbeat 2 2006-07-04 11:44:51 [MgmSrvr] WARNING -- Node 4: Node 2 missed heartbeat 2 2006-07-04 11:44:51 [MgmSrvr] WARNING -- Node 4: Node 7 missed heartbeat 3 2006-07-04 11:44:51 [MgmSrvr] WARNING -- Node 3: Node 7 missed heartbeat 3 2006-07-04 11:44:52 [MgmSrvr] WARNING -- Node 4: Node 2 missed heartbeat 3 2006-07-04 11:44:52 [MgmSrvr] WARNING -- Node 4: Node 7 missed heartbeat 4 2006-07-04 11:44:52 [MgmSrvr] ALERT -- Node 4: Node 7 declared dead due to missed heartbeat 2006-07-04 11:44:52 [MgmSrvr] INFO -- Node 4: Communication to Node 7 closed 2006-07-04 11:44:52 [MgmSrvr] WARNING -- Node 3: Node 7 missed heartbeat 4 2006-07-04 11:44:52 [MgmSrvr] ALERT -- Node 3: Node 7 declared dead due to missed heartbeat 2006-07-04 11:44:52 [MgmSrvr] INFO -- Node 3: Communication to Node 7 closed 2006-07-04 11:44:52 [MgmSrvr] ALERT -- Node 4: Node 7 Disconnected 2006-07-04 11:44:52 [MgmSrvr] ALERT -- Node 3: Node 7 Disconnected 2006-07-04 11:44:53 [MgmSrvr] INFO -- Node 1: Node 2 Connected 2006-07-04 11:44:54 [MgmSrvr] WARNING -- Node 4: Node 2 missed heartbeat 4 2006-07-04 11:44:54 [MgmSrvr] ALERT -- Node 4: Node 2 declared dead due to missed heartbeat 2006-07-04 11:44:54 [MgmSrvr] INFO -- Node 4: Communication to Node 2 closed 2006-07-04 11:44:54 [MgmSrvr] INFO -- Node 3: Communication to Node 2 closed 2006-07-04 11:44:54 [MgmSrvr] ALERT -- Node 4: Network partitioning - arbitration required 2006-07-04 11:44:54 [MgmSrvr] INFO -- Node 4: President restarts arbitration thread [state=7] 2006-07-04 11:44:54 [MgmSrvr] ALERT -- Node 4: Arbitration won - positive reply from node 1 2006-07-04 11:44:54 [MgmSrvr] INFO -- Node 4: GCP Take over started 2006-07-04 11:44:54 [MgmSrvr] INFO -- Node 4: LCP Take over started 2006-07-04 11:44:54 [MgmSrvr] INFO -- Node 4: ParticipatingDIH = 0000000000000000 2006-07-04 11:44:54 [MgmSrvr] INFO -- Node 4: ParticipatingLQH = 0000000000000000 2006-07-04 11:44:54 [MgmSrvr] INFO -- Node 4: m_LCP_COMPLETE_REP_Counter_DIH = [SignalCounter: m_count=0 0000000000000000] 2006-07-04 11:44:54 [MgmSrvr] INFO -- Node 4: m_LCP_COMPLETE_REP_Counter_LQH = [SignalCounter: m_count=0 0000000000000000] 2006-07-04 11:44:54 [MgmSrvr] INFO -- Node 4: m_LAST_LCP_FRAG_ORD = [SignalCounter: m_count=0 0000000000000000] 2006-07-04 11:44:54 [MgmSrvr] INFO -- Node 4: m_LCP_COMPLETE_REP_From_Master_Received = 1 2006-07-04 11:44:54 [MgmSrvr] INFO -- Node 4: LCP Take over completed (state = 4) 2006-07-04 11:44:54 [MgmSrvr] INFO -- Node 4: ParticipatingDIH = 0000000000000000 2006-07-04 11:44:54 [MgmSrvr] INFO -- Node 4: ParticipatingLQH = 0000000000000000 2006-07-04 11:44:54 [MgmSrvr] INFO -- Node 4: m_LCP_COMPLETE_REP_Counter_DIH = [SignalCounter: m_count=0 0000000000000000] 2006-07-04 11:44:54 [MgmSrvr] INFO -- Node 4: m_LCP_COMPLETE_REP_Counter_LQH = [SignalCounter: m_count=0 0000000000000000] 2006-07-04 11:44:54 [MgmSrvr] INFO -- Node 4: m_LAST_LCP_FRAG_ORD = [SignalCounter: m_count=0 0000000000000000] 2006-07-04 11:44:54 [MgmSrvr] INFO -- Node 4: m_LCP_COMPLETE_REP_From_Master_Received = 1 2006-07-04 11:44:54 [MgmSrvr] ALERT -- Node 4: Node 2 Disconnected 2006-07-04 11:44:54 [MgmSrvr] INFO -- Node 4: GCP Take over completed 2006-07-04 11:44:54 [MgmSrvr] ALERT -- Node 3: Node 2 Disconnected 2006-07-04 11:44:54 [MgmSrvr] INFO -- Node 3: Prepare arbitrator node 1 [ticket=13b00003395ae8a9] 2006-07-04 11:44:54 [MgmSrvr] INFO -- Node 4: Started arbitrator node 1 [ticket=13b00003395ae8a9] 2006-07-04 11:44:55 [MgmSrvr] INFO -- Node 4: Communication to Node 7 opened 2006-07-04 11:44:56 [MgmSrvr] INFO -- Node 3: Communication to Node 7 opened 2006-07-04 11:44:57 [MgmSrvr] INFO -- Node 3: Communication to Node 2 opened 2006-07-04 11:44:57 [MgmSrvr] INFO -- Node 4: Node 7 Connected 2006-07-04 11:44:57 [MgmSrvr] INFO -- Node 4: Node 7: API version 5.0.22 2006-07-04 11:44:57 [MgmSrvr] INFO -- Node 3: Node 7 Connected 2006-07-04 11:44:57 [MgmSrvr] INFO -- Node 3: Node 7: API version 5.0.22 2006-07-04 11:44:57 [MgmSrvr] INFO -- Node 4: Communication to Node 2 opened 2006-07-04 11:45:07 [MgmSrvr] ALERT -- Node 2: Forced node shutdown completed. Initiated by signal 0. 2006-07-04 11:51:24 [MgmSrvr] ALERT -- Node 4: Node 7 Disconnected 2006-07-04 11:51:24 [MgmSrvr] INFO -- Node 4: Communication to Node 7 closed 2006-07-04 11:51:24 [MgmSrvr] ALERT -- Node 3: Node 7 Disconnected 2006-07-04 11:51:24 [MgmSrvr] INFO -- Node 3: Communication to Node 7 closed 2006-07-04 11:51:25 [MgmSrvr] INFO -- Mgmt server state: nodeid 7 freed, m_reserved_nodes 0000000000007d42. 2006-07-04 11:51:27 [MgmSrvr] INFO -- Node 4: Communication to Node 7 opened 2006-07-04 11:51:27 [MgmSrvr] INFO -- Node 3: Communication to Node 7 opened 2006-07-04 11:52:30 [MgmSrvr] INFO -- Mgmt server state: nodeid 2 reserved for ip 192.168.10.36, m_reserved_nodes 0000000000007d46. 2006-07-04 11:52:32 [MgmSrvr] INFO -- Node 1: Node 2 Connected 2006-07-04 11:52:32 [MgmSrvr] INFO -- Node 2: Communication to Node 3 opened 2006-07-04 11:52:32 [MgmSrvr] INFO -- Node 2: Communication to Node 4 opened 2006-07-04 11:52:32 [MgmSrvr] INFO -- Node 2: Communication to Node 5 opened 2006-07-04 11:52:32 [MgmSrvr] INFO -- Node 2: Waiting 30 sec for nodes 0000000000000038 to connect, nodes [ all: 000000000000003c connected: 0000000000000004 no-wait: 0000000000000000 ] 2006-07-04 11:52:32 [MgmSrvr] INFO -- Node 2: Node 3 Connected 2006-07-04 11:52:32 [MgmSrvr] INFO -- Node 2: Node 4 Connected 2006-07-04 11:52:32 [MgmSrvr] INFO -- Node 2: Node 5 Connected 2006-07-04 11:52:32 [MgmSrvr] INFO -- Node 4: Node 2 Connected 2006-07-04 11:52:32 [MgmSrvr] INFO -- Node 2: CM_REGCONF president = 4, own Node = 2, our dynamic id = 7 2006-07-04 11:52:32 [MgmSrvr] INFO -- Node 3: Node 2 Connected 2006-07-04 11:52:32 [MgmSrvr] INFO -- Node 4: Node 2: API version 5.0.22 2006-07-04 11:52:32 [MgmSrvr] INFO -- Node 3: Node 2: API version 5.0.22 2006-07-04 11:52:32 [MgmSrvr] INFO -- Node 2: Node 3: API version 5.0.22 2006-07-04 11:52:32 [MgmSrvr] INFO -- Node 2: Node 4: API version 5.0.22 2006-07-04 11:52:32 [MgmSrvr] INFO -- Node 2: Node 5: API version 5.0.22 2006-07-04 11:52:32 [MgmSrvr] INFO -- Node 2: Start phase 1 completed 2006-07-04 11:52:32 [MgmSrvr] INFO -- Node 2: Receive arbitrator node 1 [ticket=13b00003395ae8a9] 2006-07-04 11:52:32 [MgmSrvr] INFO -- Node 2: Start phase 2 completed (node restart) 2006-07-04 11:52:32 [MgmSrvr] INFO -- Mgmt server state: nodeid 2 freed, m_reserved_nodes 0000000000007d42. 2006-07-04 11:52:32 [MgmSrvr] INFO -- Node 2: Start phase 3 completed (node restart) 2006-07-04 11:52:32 [MgmSrvr] INFO -- Node 2: Start phase 4 completed (node restart) 2006-07-04 11:52:39 [MgmSrvr] INFO -- Node 2: DICT: index 4 activated 2006-07-04 11:52:39 [MgmSrvr] INFO -- Node 2: DICT: index 6 activated 2006-07-04 11:52:39 [MgmSrvr] INFO -- Node 2: DICT: index 8 activated 2006-07-04 11:52:39 [MgmSrvr] INFO -- Node 2: DICT: index 9 activated 2006-07-04 11:52:39 [MgmSrvr] INFO -- Node 2: DICT: index 10 activated 2006-07-04 11:52:39 [MgmSrvr] INFO -- Node 2: DICT: index 12 activated 2006-07-04 11:52:39 [MgmSrvr] INFO -- Node 2: DICT: index 14 activated 2006-07-04 11:52:39 [MgmSrvr] INFO -- Node 2: DICT: index 16 activated 2006-07-04 11:52:39 [MgmSrvr] INFO -- Node 2: DICT: index 18 activated 2006-07-04 11:52:39 [MgmSrvr] INFO -- Node 2: DICT: index 20 activated 2006-07-04 11:52:39 [MgmSrvr] INFO -- Node 2: DICT: index 23 activated 2006-07-04 11:52:39 [MgmSrvr] INFO -- Node 2: DICT: index 25 activated 2006-07-04 11:52:39 [MgmSrvr] INFO -- Node 2: DICT: index 28 activated 2006-07-04 11:52:39 [MgmSrvr] INFO -- Node 2: DICT: index 30 activated 2006-07-04 11:52:39 [MgmSrvr] INFO -- Node 2: DICT: index 31 activated 2006-07-04 11:52:39 [MgmSrvr] INFO -- Node 2: DICT: index 32 activated 2006-07-04 11:52:39 [MgmSrvr] INFO -- Node 2: DICT: index 34 activated 2006-07-04 11:52:39 [MgmSrvr] INFO -- Node 2: DICT: index 36 activated 2006-07-04 11:52:39 [MgmSrvr] INFO -- Node 2: DICT: index 37 activated 2006-07-04 11:52:39 [MgmSrvr] INFO -- Node 2: DICT: index 38 activated 2006-07-04 11:52:39 [MgmSrvr] INFO -- Node 2: DICT: index 39 activated 2006-07-04 11:52:41 [MgmSrvr] INFO -- Node 4: Local checkpoint 708 started. Keep GCI = 1139139 oldest restorable GCI = 1139140 2006-07-04 11:53:36 [MgmSrvr] INFO -- Mgmt server state: nodeid 7 reserved for ip 192.168.10.36, m_reserved_nodes 0000000000007dc2. 2006-07-04 11:53:36 [MgmSrvr] INFO -- Node 7: mysqld --server-id=2 2006-07-04 11:53:37 [MgmSrvr] INFO -- Node 4: Node 7 Connected 2006-07-04 11:53:37 [MgmSrvr] INFO -- Node 3: Node 7 Connected 2006-07-04 11:53:37 [MgmSrvr] INFO -- Node 4: Node 7: API version 5.0.22 2006-07-04 11:53:37 [MgmSrvr] INFO -- Node 3: Node 7: API version 5.0.22 2006-07-04 11:53:58 [MgmSrvr] INFO -- Node 2: Start phase 5 completed (node restart) 2006-07-04 11:53:58 [MgmSrvr] INFO -- Node 2: Start phase 6 completed (node restart) 2006-07-04 11:53:58 [MgmSrvr] INFO -- Node 2: Start phase 7 completed (node restart) 2006-07-04 11:53:58 [MgmSrvr] INFO -- Node 2: Communication to Node 6 opened 2006-07-04 11:53:58 [MgmSrvr] INFO -- Node 2: Communication to Node 7 opened 2006-07-04 11:53:58 [MgmSrvr] INFO -- Node 2: Communication to Node 8 opened 2006-07-04 11:53:58 [MgmSrvr] INFO -- Node 2: Communication to Node 9 opened 2006-07-04 11:53:58 [MgmSrvr] INFO -- Node 2: Communication to Node 10 opened 2006-07-04 11:53:58 [MgmSrvr] INFO -- Node 2: Communication to Node 11 opened 2006-07-04 11:53:58 [MgmSrvr] INFO -- Node 2: Communication to Node 12 opened 2006-07-04 11:53:58 [MgmSrvr] INFO -- Node 2: Communication to Node 13 opened 2006-07-04 11:53:58 [MgmSrvr] INFO -- Node 2: Communication to Node 14 opened 2006-07-04 11:53:58 [MgmSrvr] INFO -- Node 2: Communication to Node 0 opened 2006-07-04 11:53:58 [MgmSrvr] INFO -- Node 2: Start phase 8 completed (node restart) 2006-07-04 11:53:58 [MgmSrvr] INFO -- Node 2: Start phase 9 completed (node restart) 2006-07-04 11:53:58 [MgmSrvr] INFO -- Node 2: Started (version 5.0.22) 2006-07-04 11:53:58 [MgmSrvr] INFO -- Node 2: Node 6 Connected 2006-07-04 11:53:58 [MgmSrvr] INFO -- Node 2: Node 7 Connected 2006-07-04 11:53:58 [MgmSrvr] INFO -- Node 2: Node 8 Connected 2006-07-04 11:53:58 [MgmSrvr] INFO -- Node 2: Node 10 Connected 2006-07-04 11:53:58 [MgmSrvr] INFO -- Node 2: Node 11 Connected 2006-07-04 11:53:58 [MgmSrvr] INFO -- Node 2: Node 12 Connected 2006-07-04 11:53:58 [MgmSrvr] INFO -- Node 2: Node 13 Connected 2006-07-04 11:53:58 [MgmSrvr] INFO -- Node 2: Node 14 Connected 2006-07-04 11:53:58 [MgmSrvr] INFO -- Node 2: Node 10: API version 5.0.22 2006-07-04 11:53:58 [MgmSrvr] INFO -- Node 2: Node 6: API version 5.0.22 2006-07-04 11:53:58 [MgmSrvr] INFO -- Node 2: Node 13: API version 5.0.22 2006-07-04 11:53:58 [MgmSrvr] INFO -- Node 2: Node 14: API version 5.0.22 2006-07-04 11:53:58 [MgmSrvr] INFO -- Node 2: Node 12: API version 5.0.22 2006-07-04 11:53:58 [MgmSrvr] INFO -- Node 2: Node 8: API version 5.0.22 2006-07-04 11:53:58 [MgmSrvr] INFO -- Node 2: Node 11: API version 5.0.22 2006-07-04 11:53:58 [MgmSrvr] INFO -- Node 2: Node 7: API version 5.0.22 2006-07-04 11:53:59 [MgmSrvr] INFO -- Node 2: Node 1: API version 5.0.22 2006-07-04 12:00:03 [MgmSrvr] WARNING -- Node 3: Node 7 missed heartbeat 2 2006-07-04 12:00:04 [MgmSrvr] WARNING -- Node 4: Node 2 missed heartbeat 2 2006-07-04 12:00:04 [MgmSrvr] WARNING -- Node 4: Node 7 missed heartbeat 2 2006-07-04 12:00:05 [MgmSrvr] WARNING -- Node 3: Node 7 missed heartbeat 3 2006-07-04 12:00:05 [MgmSrvr] WARNING -- Node 4: Node 2 missed heartbeat 3 2006-07-04 12:00:05 [MgmSrvr] WARNING -- Node 4: Node 7 missed heartbeat 3 2006-07-04 12:00:05 [MgmSrvr] INFO -- Node 1: Node 2 Connected 2006-07-04 12:00:07 [MgmSrvr] WARNING -- Node 3: Node 7 missed heartbeat 4 2006-07-04 12:00:07 [MgmSrvr] ALERT -- Node 3: Node 7 declared dead due to missed heartbeat 2006-07-04 12:00:07 [MgmSrvr] INFO -- Node 3: Communication to Node 7 closed 2006-07-04 12:00:07 [MgmSrvr] WARNING -- Node 4: Node 2 missed heartbeat 4 2006-07-04 12:00:07 [MgmSrvr] ALERT -- Node 4: Node 2 declared dead due to missed heartbeat 2006-07-04 12:00:07 [MgmSrvr] WARNING -- Node 4: Node 7 missed heartbeat 4 2006-07-04 12:00:07 [MgmSrvr] ALERT -- Node 4: Node 7 declared dead due to missed heartbeat 2006-07-04 12:00:07 [MgmSrvr] INFO -- Node 4: Communication to Node 7 closed 2006-07-04 12:00:07 [MgmSrvr] INFO -- Node 4: Communication to Node 2 closed 2006-07-04 12:00:07 [MgmSrvr] INFO -- Node 3: Communication to Node 2 closed 2006-07-04 12:00:07 [MgmSrvr] ALERT -- Node 4: Network partitioning - arbitration required 2006-07-04 12:00:07 [MgmSrvr] INFO -- Node 4: President restarts arbitration thread [state=7] 2006-07-04 12:00:07 [MgmSrvr] ALERT -- Node 4: Arbitration won - positive reply from node 1 2006-07-04 12:00:07 [MgmSrvr] ALERT -- Node 3: Node 7 Disconnected 2006-07-04 12:00:07 [MgmSrvr] ALERT -- Node 4: Node 2 Disconnected 2006-07-04 12:00:07 [MgmSrvr] ALERT -- Node 4: Node 7 Disconnected 2006-07-04 12:00:07 [MgmSrvr] ALERT -- Node 3: Node 2 Disconnected 2006-07-04 12:00:07 [MgmSrvr] INFO -- Node 3: Prepare arbitrator node 1 [ticket=13b000043968d63c] 2006-07-04 12:00:07 [MgmSrvr] INFO -- Node 4: Started arbitrator node 1 [ticket=13b000043968d63c] 2006-07-04 12:00:10 [MgmSrvr] INFO -- Node 4: Communication to Node 2 opened 2006-07-04 12:00:10 [MgmSrvr] INFO -- Node 4: Communication to Node 7 opened 2006-07-04 12:00:10 [MgmSrvr] INFO -- Node 3: Communication to Node 2 opened 2006-07-04 12:00:10 [MgmSrvr] INFO -- Node 3: Communication to Node 7 opened 2006-07-04 12:00:10 [MgmSrvr] INFO -- Node 4: Node 7 Connected 2006-07-04 12:00:10 [MgmSrvr] INFO -- Node 4: Node 7: API version 5.0.22 2006-07-04 12:00:11 [MgmSrvr] INFO -- Node 3: Node 7 Connected 2006-07-04 12:00:11 [MgmSrvr] INFO -- Node 3: Node 7: API version 5.0.22 2006-07-04 12:00:19 [MgmSrvr] ALERT -- Node 2: Forced node shutdown completed. Initiated by signal 0. Caused by error 2305: 'Arbitrator shutdown, please investigate error(s) on other node(s)(Arbitration error). Temporary error, restart node'. 2006-07-04 12:50:37 [MgmSrvr] INFO -- Node 4: Local checkpoint 709 started. Keep GCI = 1140179 oldest restorable GCI = 1140140 2006-07-04 13:47:20 [MgmSrvr] INFO -- Node 4: Local checkpoint 710 started. Keep GCI = 1141791 oldest restorable GCI = 1141720 2006-07-04 14:43:56 [MgmSrvr] INFO -- Node 4: Local checkpoint 711 started. Keep GCI = 1143407 oldest restorable GCI = 1143402 2006-07-04 15:06:09 [MgmSrvr] ALERT -- Node 4: Node 7 Disconnected 2006-07-04 15:06:09 [MgmSrvr] INFO -- Node 4: Communication to Node 7 closed 2006-07-04 15:06:09 [MgmSrvr] ALERT -- Node 3: Node 7 Disconnected 2006-07-04 15:06:09 [MgmSrvr] INFO -- Node 3: Communication to Node 7 closed 2006-07-04 15:06:10 [MgmSrvr] INFO -- Mgmt server state: nodeid 7 freed, m_reserved_nodes 0000000000007d42. 2006-07-04 15:06:12 [MgmSrvr] INFO -- Node 4: Communication to Node 7 opened 2006-07-04 15:06:13 [MgmSrvr] INFO -- Node 3: Communication to Node 7 opened 2006-07-04 15:06:28 [MgmSrvr] INFO -- Mgmt server state: nodeid 7 reserved for ip 192.168.10.36, m_reserved_nodes 0000000000007dc2. 2006-07-04 15:06:28 [MgmSrvr] INFO -- Node 7: mysqld --server-id=2 2006-07-04 15:06:28 [MgmSrvr] INFO -- Node 3: Node 7 Connected 2006-07-04 15:06:28 [MgmSrvr] INFO -- Node 4: Node 7 Connected 2006-07-04 15:06:28 [MgmSrvr] INFO -- Node 3: Node 7: API version 5.0.22 2006-07-04 15:06:28 [MgmSrvr] INFO -- Node 4: Node 7: API version 5.0.22 2006-07-04 15:25:40 [MgmSrvr] ALERT -- Node 4: Node 7 Disconnected 2006-07-04 15:25:40 [MgmSrvr] INFO -- Node 4: Communication to Node 7 closed 2006-07-04 15:25:40 [MgmSrvr] ALERT -- Node 3: Node 7 Disconnected 2006-07-04 15:25:40 [MgmSrvr] INFO -- Node 3: Communication to Node 7 closed 2006-07-04 15:25:40 [MgmSrvr] INFO -- Mgmt server state: nodeid 7 freed, m_reserved_nodes 0000000000007d42. 2006-07-04 15:25:43 [MgmSrvr] INFO -- Node 4: Communication to Node 7 opened 2006-07-04 15:25:43 [MgmSrvr] INFO -- Node 3: Communication to Node 7 opened 2006-07-04 15:40:17 [MgmSrvr] INFO -- Node 4: Local checkpoint 712 started. Keep GCI = 1145014 oldest restorable GCI = 1145019 2006-07-04 16:37:05 [MgmSrvr] INFO -- Node 4: Local checkpoint 713 started. Keep GCI = 1146615 oldest restorable GCI = 1146544 2006-07-04 17:34:02 [MgmSrvr] INFO -- Node 4: Local checkpoint 714 started. Keep GCI = 1148229 oldest restorable GCI = 1148187 2006-07-04 18:31:04 [MgmSrvr] INFO -- Node 4: Local checkpoint 715 started. Keep GCI = 1149849 oldest restorable GCI = 1149850 2006-07-04 19:28:01 [MgmSrvr] INFO -- Node 4: Local checkpoint 716 started. Keep GCI = 1151470 oldest restorable GCI = 1151446 2006-07-04 20:25:07 [MgmSrvr] INFO -- Node 4: Local checkpoint 717 started. Keep GCI = 1153090 oldest restorable GCI = 1152990 2006-07-04 21:22:10 [MgmSrvr] INFO -- Node 4: Local checkpoint 718 started. Keep GCI = 1154713 oldest restorable GCI = 1154696 2006-07-04 22:19:12 [MgmSrvr] INFO -- Node 4: Local checkpoint 719 started. Keep GCI = 1156339 oldest restorable GCI = 1156343 2006-07-04 23:16:10 [MgmSrvr] INFO -- Node 4: Local checkpoint 720 started. Keep GCI = 1157964 oldest restorable GCI = 1157813 2006-07-05 00:13:04 [MgmSrvr] INFO -- Node 4: Local checkpoint 721 started. Keep GCI = 1159586 oldest restorable GCI = 1159522 2006-07-05 01:10:06 [MgmSrvr] INFO -- Node 4: Local checkpoint 722 started. Keep GCI = 1161208 oldest restorable GCI = 1161189 2006-07-05 02:07:16 [MgmSrvr] INFO -- Node 4: Local checkpoint 723 started. Keep GCI = 1162835 oldest restorable GCI = 1162659 2006-07-05 03:04:23 [MgmSrvr] INFO -- Node 4: Local checkpoint 724 started. Keep GCI = 1164466 oldest restorable GCI = 1164387 2006-07-05 04:01:32 [MgmSrvr] INFO -- Node 4: Local checkpoint 725 started. Keep GCI = 1166097 oldest restorable GCI = 1166100 2006-07-05 04:58:37 [MgmSrvr] INFO -- Node 4: Local checkpoint 726 started. Keep GCI = 1167731 oldest restorable GCI = 1167513 2006-07-05 05:55:35 [MgmSrvr] INFO -- Node 4: Local checkpoint 727 started. Keep GCI = 1169362 oldest restorable GCI = 1169249