2010-01-04 10:12:17 [MgmtSrvr] INFO -- Mgmt server state: nodeid 1 reserved for ip 10.26.86.99, m_reserved_nodes 0000000000000000000000000000000000000000000000000000000000000002. 2010-01-04 10:12:17 [MgmtSrvr] INFO -- Node 1: Node 1 Connected 2010-01-04 10:12:17 [MgmtSrvr] INFO -- Id: 1, Command port: *:1186 2010-01-04 10:12:17 [MgmtSrvr] INFO -- Node 1: Node 2 Connected 2010-01-04 10:12:18 [MgmtSrvr] INFO -- Node 1: Node 3 Connected 2010-01-04 10:12:18 [MgmtSrvr] INFO -- Node 2: Started arbitrator node 1 [ticket=60070002617158fc] 2010-01-04 10:13:15 [MgmtSrvr] INFO -- Node 2: Node shutdown completed. Initiated by signal 15. 2010-01-04 10:13:15 [MgmtSrvr] ALERT -- Node 1: Node 2 Disconnected 2010-01-04 10:13:15 [MgmtSrvr] ALERT -- Node 3: Node 2 Disconnected 2010-01-04 10:13:15 [MgmtSrvr] INFO -- Node 3: Communication to Node 2 closed 2010-01-04 10:13:15 [MgmtSrvr] ALERT -- Node 3: Network partitioning - arbitration required 2010-01-04 10:13:15 [MgmtSrvr] INFO -- Node 3: President restarts arbitration thread [state=7] 2010-01-04 10:13:15 [MgmtSrvr] ALERT -- Node 3: Arbitration won - positive reply from node 1 2010-01-04 10:13:15 [MgmtSrvr] INFO -- Node 3: GCP Take over started 2010-01-04 10:13:15 [MgmtSrvr] INFO -- Node 3: Node 3 taking over as DICT master 2010-01-04 10:13:15 [MgmtSrvr] INFO -- Node 3: GCP Take over completed 2010-01-04 10:13:15 [MgmtSrvr] INFO -- Node 3: kk: 278476/7 0 0 2010-01-04 10:13:15 [MgmtSrvr] INFO -- Node 3: LCP Take over started 2010-01-04 10:13:15 [MgmtSrvr] INFO -- Node 3: ParticipatingDIH = 0000000000000000 2010-01-04 10:13:15 [MgmtSrvr] INFO -- Node 3: ParticipatingLQH = 0000000000000000 2010-01-04 10:13:15 [MgmtSrvr] INFO -- Node 3: m_LCP_COMPLETE_REP_Counter_DIH = [SignalCounter: m_count=0 0000000000000000] 2010-01-04 10:13:15 [MgmtSrvr] INFO -- Node 3: m_LCP_COMPLETE_REP_Counter_LQH = [SignalCounter: m_count=0 0000000000000000] 2010-01-04 10:13:15 [MgmtSrvr] INFO -- Node 3: m_LAST_LCP_FRAG_ORD = [SignalCounter: m_count=0 0000000000000000] 2010-01-04 10:13:15 [MgmtSrvr] INFO -- Node 3: m_LCP_COMPLETE_REP_From_Master_Received = 1 2010-01-04 10:13:15 [MgmtSrvr] INFO -- Node 3: LCP Take over completed (state = 4) 2010-01-04 10:13:15 [MgmtSrvr] INFO -- Node 3: ParticipatingDIH = 0000000000000000 2010-01-04 10:13:15 [MgmtSrvr] INFO -- Node 3: ParticipatingLQH = 0000000000000000 2010-01-04 10:13:15 [MgmtSrvr] INFO -- Node 3: m_LCP_COMPLETE_REP_Counter_DIH = [SignalCounter: m_count=0 0000000000000000] 2010-01-04 10:13:15 [MgmtSrvr] INFO -- Node 3: m_LCP_COMPLETE_REP_Counter_LQH = [SignalCounter: m_count=0 0000000000000000] 2010-01-04 10:13:15 [MgmtSrvr] INFO -- Node 3: m_LAST_LCP_FRAG_ORD = [SignalCounter: m_count=0 0000000000000000] 2010-01-04 10:13:15 [MgmtSrvr] INFO -- Node 3: m_LCP_COMPLETE_REP_From_Master_Received = 1 2010-01-04 10:13:16 [MgmtSrvr] INFO -- Node 3: Started arbitrator node 1 [ticket=5233000377ccb18b] 2010-01-04 10:13:19 [MgmtSrvr] INFO -- Node 3: Communication to Node 2 opened 2010-01-04 10:13:21 [MgmtSrvr] INFO -- Mgmt server state: nodeid 2 reserved for ip 10.26.86.99, m_reserved_nodes 0000000000000000000000000000000000000000000000000000000000000006. 2010-01-04 10:13:21 [MgmtSrvr] INFO -- Node 1: Node 2 Connected 2010-01-04 10:13:22 [MgmtSrvr] INFO -- Node 2: CM_REGCONF president = 3, own Node = 2, our dynamic id = 3 2010-01-04 10:13:22 [MgmtSrvr] INFO -- Node 3: Node 2 Connected 2010-01-04 10:13:22 [MgmtSrvr] INFO -- Node 2: Node 3: API mysql-5.1.39 ndb-7.0.9 2010-01-04 10:13:22 [MgmtSrvr] INFO -- Node 2: Start phase 1 completed 2010-01-04 10:13:22 [MgmtSrvr] INFO -- Node 3: Node 2: API mysql-5.1.39 ndb-7.0.9 2010-01-04 10:13:22 [MgmtSrvr] INFO -- Node 2: Start phase 2 completed (initial node restart) 2010-01-04 10:13:22 [MgmtSrvr] INFO -- Node 3: DICT: locked by node 2 for NodeRestart 2010-01-04 10:13:22 [MgmtSrvr] INFO -- Node 2: Receive arbitrator node 1 [ticket=5233000377ccb18b] 2010-01-04 10:13:22 [MgmtSrvr] INFO -- Mgmt server state: nodeid 2 freed, m_reserved_nodes 0000000000000000000000000000000000000000000000000000000000000002. 2010-01-04 10:13:22 [MgmtSrvr] INFO -- Node 2: Start phase 3 completed (initial node restart) 2010-01-04 10:13:22 [MgmtSrvr] INFO -- Node 2: Local redo log file initialization status: #Total files: 64, Completed: 0 #Total MBytes: 1024, Completed: 0 2010-01-04 10:13:23 [MgmtSrvr] INFO -- Node 2: Local redo log file initialization completed: #Total files: 64, Completed: 64 #Total MBytes: 1024, Completed: 1024 2010-01-04 10:13:23 [MgmtSrvr] INFO -- Node 2: Start phase 4 completed (initial node restart) 2010-01-04 10:13:24 [MgmtSrvr] INFO -- Node 2: Starting to restore schema 2010-01-04 10:13:25 [MgmtSrvr] INFO -- Node 2: Restore of schema complete 2010-01-04 10:13:25 [MgmtSrvr] INFO -- Node 2: DICT: activate index 8 done (sys/def/7/PRIMARY) 2010-01-04 10:13:25 [MgmtSrvr] INFO -- Node 2: Node: 2 StartLog: [GCI Keep: 273594 LastCompleted: 278475 NewestRestorable: 278480] 2010-01-04 10:13:25 [MgmtSrvr] INFO -- Node 3: Node 2 waiting to continue copying table 2 fragment: 0 (STORED) 2010-01-04 10:13:38 [MgmtSrvr] INFO -- Node 3: Local checkpoint 108 started. Keep GCI = 276206 oldest restorable GCI = 248622 2010-01-04 10:13:42 [MgmtSrvr] INFO -- Node 2: Suma: asking node 3 to recreate subscriptions on me 2010-01-04 10:13:43 [MgmtSrvr] INFO -- Node 2: Suma: node 3 has completed restoring me 2010-01-04 10:13:43 [MgmtSrvr] INFO -- Node 2: Start phase 5 completed (initial node restart) 2010-01-04 10:13:43 [MgmtSrvr] INFO -- Node 2: Start phase 6 completed (initial node restart) 2010-01-04 10:13:43 [MgmtSrvr] INFO -- Node 2: Start phase 7 completed (initial node restart) 2010-01-04 10:13:43 [MgmtSrvr] INFO -- Node 2: Start phase 8 completed (initial node restart) 2010-01-04 10:13:43 [MgmtSrvr] INFO -- Node 2: Start phase 9 completed (initial node restart) 2010-01-04 10:13:43 [MgmtSrvr] INFO -- Node 2: Start phase 100 completed (initial node restart) 2010-01-04 10:13:43 [MgmtSrvr] INFO -- Node 2: Communication to Node 4 opened 2010-01-04 10:13:43 [MgmtSrvr] INFO -- Node 2: Communication to Node 5 opened 2010-01-04 10:13:43 [MgmtSrvr] INFO -- Node 2: Node 1: API mysql-5.1.39 ndb-7.0.9 2010-01-04 10:13:43 [MgmtSrvr] INFO -- Node 2: Node 4 Connected 2010-01-04 10:13:43 [MgmtSrvr] INFO -- Node 2: Node 5 Connected 2010-01-04 10:13:43 [MgmtSrvr] INFO -- Node 2: Node 5: API mysql-5.1.39 ndb-7.0.9 2010-01-04 10:13:43 [MgmtSrvr] INFO -- Node 2: Node 4: API mysql-5.1.39 ndb-7.0.9 2010-01-04 10:13:43 [MgmtSrvr] INFO -- Node 2: Suma: initiate handover with nodes 0000000000000008 GCI: 278493 2010-01-04 10:13:43 [MgmtSrvr] INFO -- Node 2: Suma: handover from node 3 gci: 278493 buckets: 00000001 (2) 2010-01-04 10:13:49 [MgmtSrvr] INFO -- Node 2: Start phase 101 completed (initial node restart) 2010-01-04 10:13:49 [MgmtSrvr] INFO -- Node 2: Started (mysql-5.1.39 ndb-7.0.9) 2010-01-04 10:13:49 [MgmtSrvr] INFO -- Node 3: DICT: unlocked by node 2 for NodeRestart 2010-01-04 10:17:36 [MgmtSrvr] INFO -- Mgmt server state: nodeid 1 reserved for ip 10.26.86.99, m_reserved_nodes 0000000000000000000000000000000000000000000000000000000000000002. 2010-01-04 10:17:36 [MgmtSrvr] INFO -- Node 1: Node 1 Connected 2010-01-04 10:17:36 [MgmtSrvr] INFO -- Id: 1, Command port: *:1186 2010-01-04 10:17:41 [MgmtSrvr] INFO -- Mgmt server state: nodeid 2 reserved for ip 10.26.86.99, m_reserved_nodes 0000000000000000000000000000000000000000000000000000000000000006. 2010-01-04 10:17:41 [MgmtSrvr] INFO -- Node 1: Node 2 Connected 2010-01-04 10:17:42 [MgmtSrvr] INFO -- Mgmt server state: nodeid 2 freed, m_reserved_nodes 0000000000000000000000000000000000000000000000000000000000000002. 2010-01-04 10:17:45 [MgmtSrvr] INFO -- Node 2: Initial start, waiting for 3 to connect, nodes [ all: 2 and 3 connected: 2 no-wait: ] 2010-01-04 10:17:48 [MgmtSrvr] INFO -- Node 2: Initial start, waiting for 3 to connect, nodes [ all: 2 and 3 connected: 2 no-wait: ] 2010-01-04 10:17:51 [MgmtSrvr] INFO -- Node 2: Initial start, waiting for 3 to connect, nodes [ all: 2 and 3 connected: 2 no-wait: ] 2010-01-04 10:17:53 [MgmtSrvr] INFO -- Mgmt server state: nodeid 3 reserved for ip 10.250.50.14, m_reserved_nodes 000000000000000000000000000000000000000000000000000000000000000a. 2010-01-04 10:17:54 [MgmtSrvr] INFO -- Node 2: Initial start, waiting for 3 to connect, nodes [ all: 2 and 3 connected: 2 no-wait: ] 2010-01-04 10:17:54 [MgmtSrvr] INFO -- Node 1: Node 3 Connected 2010-01-04 10:17:54 [MgmtSrvr] INFO -- Mgmt server state: nodeid 3 freed, m_reserved_nodes 0000000000000000000000000000000000000000000000000000000000000002. 2010-01-04 10:17:55 [MgmtSrvr] INFO -- Node 3: Start phase 0 completed 2010-01-04 10:17:55 [MgmtSrvr] INFO -- Node 3: Communication to Node 2 opened 2010-01-04 10:17:55 [MgmtSrvr] INFO -- Node 3: Initial start, waiting for 2 to connect, nodes [ all: 2 and 3 connected: 3 no-wait: ] 2010-01-04 10:17:55 [MgmtSrvr] INFO -- Node 2: Node 3 Connected 2010-01-04 10:17:55 [MgmtSrvr] INFO -- Node 3: Node 2 Connected 2010-01-04 10:17:56 [MgmtSrvr] INFO -- Node 2: Initial start with nodes 2 and 3 [ missing: no-wait: ] 2010-01-04 10:17:56 [MgmtSrvr] INFO -- Node 2: CM_REGCONF president = 2, own Node = 2, our dynamic id = 1 2010-01-04 10:17:58 [MgmtSrvr] INFO -- Node 3: CM_REGCONF president = 2, own Node = 3, our dynamic id = 2 2010-01-04 10:17:58 [MgmtSrvr] INFO -- Node 2: Node 3: API mysql-5.1.39 ndb-7.0.9 2010-01-04 10:17:58 [MgmtSrvr] INFO -- Node 2: Start phase 1 completed 2010-01-04 10:17:58 [MgmtSrvr] INFO -- Node 3: Node 2: API mysql-5.1.39 ndb-7.0.9 2010-01-04 10:17:58 [MgmtSrvr] INFO -- Node 3: Start phase 1 completed 2010-01-04 10:17:58 [MgmtSrvr] INFO -- Node 2: Start phase 2 completed (initial start) 2010-01-04 10:17:58 [MgmtSrvr] INFO -- Node 2: Start phase 3 completed (initial start) 2010-01-04 10:17:58 [MgmtSrvr] INFO -- Node 2: Local redo log file initialization status: #Total files: 64, Completed: 0 #Total MBytes: 1024, Completed: 0 2010-01-04 10:17:59 [MgmtSrvr] INFO -- Node 3: Start phase 2 completed (initial start) 2010-01-04 10:17:59 [MgmtSrvr] INFO -- Node 3: Start phase 3 completed (initial start) 2010-01-04 10:17:59 [MgmtSrvr] INFO -- Node 3: Local redo log file initialization status: #Total files: 64, Completed: 0 #Total MBytes: 1024, Completed: 0 2010-01-04 10:17:59 [MgmtSrvr] INFO -- Node 2: Local redo log file initialization completed: #Total files: 64, Completed: 64 #Total MBytes: 1024, Completed: 1024 2010-01-04 10:18:01 [MgmtSrvr] INFO -- Node 3: Local redo log file initialization completed: #Total files: 64, Completed: 64 #Total MBytes: 1024, Completed: 1024 2010-01-04 10:18:01 [MgmtSrvr] INFO -- Node 2: Start phase 4 completed (initial start) 2010-01-04 10:18:01 [MgmtSrvr] INFO -- Node 3: Start phase 4 completed (initial start) 2010-01-04 10:18:21 [MgmtSrvr] INFO -- Node 2: Local checkpoint 1 started. Keep GCI = 1 oldest restorable GCI = 1 2010-01-04 10:18:22 [MgmtSrvr] INFO -- Node 2: Start phase 5 completed (initial start) 2010-01-04 10:18:22 [MgmtSrvr] INFO -- Node 2: Start phase 6 completed (initial start) 2010-01-04 10:18:22 [MgmtSrvr] INFO -- Node 2: President restarts arbitration thread [state=1] 2010-01-04 10:18:22 [MgmtSrvr] INFO -- Node 3: Start phase 5 completed (initial start) 2010-01-04 10:18:22 [MgmtSrvr] INFO -- Node 3: Start phase 6 completed (initial start) 2010-01-04 10:18:22 [MgmtSrvr] INFO -- Node 3: Start phase 7 completed (initial start) 2010-01-04 10:18:23 [MgmtSrvr] INFO -- Node 2: Start phase 7 completed (initial start) 2010-01-04 10:18:23 [MgmtSrvr] INFO -- Node 2: Start phase 8 completed (initial start) 2010-01-04 10:18:23 [MgmtSrvr] INFO -- Node 2: Start phase 9 completed (initial start) 2010-01-04 10:18:23 [MgmtSrvr] INFO -- Node 2: Start phase 100 completed (initial start) 2010-01-04 10:18:23 [MgmtSrvr] INFO -- Node 2: Start phase 101 completed (initial start) 2010-01-04 10:18:23 [MgmtSrvr] INFO -- Node 2: Started (mysql-5.1.39 ndb-7.0.9) 2010-01-04 10:18:23 [MgmtSrvr] INFO -- Node 2: Node 1: API mysql-5.1.39 ndb-7.0.9 2010-01-04 10:18:23 [MgmtSrvr] INFO -- Node 3: Start phase 8 completed (initial start) 2010-01-04 10:18:23 [MgmtSrvr] INFO -- Node 3: Start phase 9 completed (initial start) 2010-01-04 10:18:23 [MgmtSrvr] INFO -- Node 3: Start phase 100 completed (initial start) 2010-01-04 10:18:23 [MgmtSrvr] INFO -- Node 3: Start phase 101 completed (initial start) 2010-01-04 10:18:23 [MgmtSrvr] INFO -- Node 3: Started (mysql-5.1.39 ndb-7.0.9) 2010-01-04 10:18:23 [MgmtSrvr] INFO -- Node 3: Node 1: API mysql-5.1.39 ndb-7.0.9 2010-01-04 10:18:23 [MgmtSrvr] INFO -- Node 3: Prepare arbitrator node 1 [ticket=1c1f000161774c89] 2010-01-04 10:18:23 [MgmtSrvr] INFO -- Node 2: Started arbitrator node 1 [ticket=1c1f000161774c89] 2010-01-04 10:18:23 [MgmtSrvr] INFO -- Node 2: Communication to Node 4 opened 2010-01-04 10:18:23 [MgmtSrvr] INFO -- Node 2: Communication to Node 5 opened 2010-01-04 10:18:23 [MgmtSrvr] INFO -- Node 2: Node 4 Connected 2010-01-04 10:18:23 [MgmtSrvr] INFO -- Node 2: Node 4: API mysql-5.1.39 ndb-7.0.9 2010-01-04 10:18:23 [MgmtSrvr] INFO -- Node 3: Communication to Node 4 opened 2010-01-04 10:18:23 [MgmtSrvr] INFO -- Node 3: Communication to Node 5 opened 2010-01-04 10:18:24 [MgmtSrvr] INFO -- Node 2: Node 5 Connected 2010-01-04 10:18:24 [MgmtSrvr] INFO -- Node 2: Node 5: API mysql-5.1.39 ndb-7.0.9 2010-01-04 10:18:24 [MgmtSrvr] INFO -- Node 3: Node 4 Connected 2010-01-04 10:18:24 [MgmtSrvr] INFO -- Node 3: Node 4: API mysql-5.1.39 ndb-7.0.9 2010-01-04 10:18:24 [MgmtSrvr] INFO -- Node 3: Node 5 Connected 2010-01-04 10:18:24 [MgmtSrvr] INFO -- Node 3: Node 5: API mysql-5.1.39 ndb-7.0.9