2007-07-18 13:41:59 [ndbd] INFO -- Angel pid: 25634 ndb pid: 25635 2007-07-18 13:41:59 [ndbd] INFO -- NDB Cluster -- DB node 2 2007-07-18 13:41:59 [ndbd] INFO -- Version 5.1.20 (beta) -- 2007-07-18 13:41:59 [ndbd] INFO -- Configuration fetched at 10.104.49.185 port 1186 2007-07-18 13:41:59 [ndbd] INFO -- WatchDog timer is set to 30000 ms 2007-07-18 13:42:00 [ndbd] INFO -- Start initiated (version 5.1.20) 2007-07-18 13:42:00 [ndbd] INFO -- Ndbd_mem_manager::init(1) min: 20Mb initial: 20Mb WOPool::init(61, 9) RWPool::init(82, 13) RWPool::init(a2, 18) RWPool::init(c2, 13) RWPool::init(122, 18) RWPool::init(142, 18) WOPool::init(41, 12) RWPool::init(e2, 12) RWPool::init(102, 52) WOPool::init(21, 10) 2007-07-18 13:42:00 [ndbd] INFO -- Start phase 0 completed 2007-07-18 13:42:00 [ndbd] INFO -- CM_REGREF from Node 2 to our Node 2. Cause = Election without selecting new candidate 2007-07-18 13:42:00 [ndbd] INFO -- Initial start, waiting for 0000000000000008 to connect, nodes [ all: 000000000000000c connected: 0000000000000004 no-wait: 0000000000000000 ] m_active_buckets.set(0) table 2 options 3 table 3 options 1 reportAllSubscribers subPtr.i: 0 subPtr.p->n_subscribers: 1 sent SUBSCRIBE(11) to node 5, req_nodeid: 5 senderData: 8 reportAllSubscribers subPtr.i: 0 subPtr.p->n_subscribers: 2 sent SUBSCRIBE(11) to node 4, req_nodeid: 4 senderData: 24 sent SUBSCRIBE(11) to node 5, req_nodeid: 4 senderData: 8 sent SUBSCRIBE(11) to node 4, req_nodeid: 5 senderData: 24 table 4 options 0 table 50 options 0 table 20 options 0 table 49 options 0 table 13 options 0 table 41 options 0 table 18 options 0 table 6 options 0 table 31 options 0 table 19 options 0 table 30 options 0 table 11 options 0 reportAllSubscribers subPtr.i: 0 subPtr.p->n_subscribers: 1 sent UNSUBSCRIBE(12) to node 5, req_nodeid: 4 senderData: 8 sent UNSUBSCRIBE(12) to node 4, req_nodeid: 5 senderData: 24 reportAllSubscribers subPtr.i: 0 subPtr.p->n_subscribers: 2 sent SUBSCRIBE(11) to node 4, req_nodeid: 4 senderData: 24 sent SUBSCRIBE(11) to node 5, req_nodeid: 4 senderData: 8 sent SUBSCRIBE(11) to node 4, req_nodeid: 5 senderData: 24 reportAllSubscribers subPtr.i: 0 subPtr.p->n_subscribers: 1 sent UNSUBSCRIBE(12) to node 4, req_nodeid: 5 senderData: 24 sent UNSUBSCRIBE(12) to node 5, req_nodeid: 4 senderData: 8 reportAllSubscribers subPtr.i: 0 subPtr.p->n_subscribers: 2 sent SUBSCRIBE(11) to node 5, req_nodeid: 5 senderData: 24 sent SUBSCRIBE(11) to node 4, req_nodeid: 5 senderData: 24 sent SUBSCRIBE(11) to node 5, req_nodeid: 4 senderData: 24 2007-08-07 15:43:25 [ndbd] INFO -- Watchdog: User time: 217487 System time: 131926 2007-08-07 15:43:25 [ndbd] WARNING -- Watchdog: Warning overslept 390 ms, expected 100 ms. 2007-08-07 16:09:04 [ndbd] INFO -- Watchdog: User time: 217531 System time: 131996 2007-08-07 16:09:04 [ndbd] WARNING -- Watchdog: Warning overslept 308 ms, expected 100 ms. 2007-08-23 15:59:09 [ndbd] WARNING -- Ndb kernel is stuck in: Polling for Receive 2007-08-23 15:59:09 [ndbd] INFO -- Watchdog: User time: 319226 System time: 206764 2007-08-23 15:59:10 [ndbd] WARNING -- Ndb kernel is stuck in: Polling for Receive 2007-08-23 15:59:10 [ndbd] INFO -- Watchdog: User time: 319226 System time: 206764 2007-08-23 15:59:10 [ndbd] WARNING -- Ndb kernel is stuck in: Polling for Receive 2007-08-23 15:59:10 [ndbd] INFO -- Watchdog: User time: 319226 System time: 206766 2007-08-23 15:59:10 [ndbd] WARNING -- Ndb kernel is stuck in: Polling for Receive 2007-08-23 15:59:10 [ndbd] INFO -- Watchdog: User time: 319226 System time: 206766 2007-08-23 15:59:56 [ndbd] WARNING -- Ndb kernel is stuck in: Polling for Receive 2007-08-23 15:59:56 [ndbd] INFO -- Watchdog: User time: 319227 System time: 206768 2007-08-23 15:59:57 [ndbd] WARNING -- Ndb kernel is stuck in: Polling for Receive 2007-08-23 15:59:57 [ndbd] INFO -- Watchdog: User time: 319227 System time: 206769 2007-08-23 15:59:57 [ndbd] WARNING -- Ndb kernel is stuck in: Polling for Receive 2007-08-23 15:59:57 [ndbd] INFO -- Watchdog: User time: 319227 System time: 206769 2007-08-23 16:00:25 [ndbd] WARNING -- Ndb kernel is stuck in: Polling for Receive 2007-08-23 16:00:25 [ndbd] INFO -- Watchdog: User time: 319229 System time: 206772 2007-08-23 16:00:25 [ndbd] WARNING -- Ndb kernel is stuck in: Polling for Receive 2007-08-23 16:00:25 [ndbd] INFO -- Watchdog: User time: 319229 System time: 206773 2007-08-23 16:00:32 [ndbd] WARNING -- Ndb kernel is stuck in: Polling for Receive 2007-08-23 16:00:32 [ndbd] INFO -- Watchdog: User time: 319229 System time: 206774 2007-08-23 16:00:32 [ndbd] WARNING -- Ndb kernel is stuck in: Polling for Receive 2007-08-23 16:00:32 [ndbd] INFO -- Watchdog: User time: 319229 System time: 206775 2007-09-07 22:40:46 [ndbd] WARNING -- Ndb kernel is stuck in: Job Handling 2007-09-07 22:40:46 [ndbd] INFO -- Watchdog: User time: 10711097 System time: 619598 2007-09-08 00:00:54 [ndbd] WARNING -- Ndb kernel is stuck in: Polling for Receive 2007-09-08 00:00:54 [ndbd] INFO -- Watchdog: User time: 11047058 System time: 629907 2007-09-08 00:00:54 [ndbd] WARNING -- Ndb kernel is stuck in: Polling for Receive 2007-09-08 00:00:54 [ndbd] INFO -- Watchdog: User time: 11047058 System time: 629907 2007-09-08 00:00:54 [ndbd] WARNING -- Ndb kernel is stuck in: Polling for Receive 2007-09-08 00:00:54 [ndbd] INFO -- Watchdog: User time: 11047058 System time: 629907 2007-09-08 00:06:59 [ndbd] WARNING -- Ndb kernel is stuck in: Job Handling 2007-09-08 00:06:59 [ndbd] INFO -- Watchdog: User time: 11072036 System time: 630659 2007-09-08 00:06:59 [ndbd] WARNING -- Ndb kernel is stuck in: Job Handling 2007-09-08 00:06:59 [ndbd] INFO -- Watchdog: User time: 11072036 System time: 630659 2007-09-08 00:06:59 [ndbd] WARNING -- Ndb kernel is stuck in: Job Handling 2007-09-08 00:06:59 [ndbd] INFO -- Watchdog: User time: 11072036 System time: 630659 2007-09-08 00:56:01 [ndbd] WARNING -- Ndb kernel is stuck in: Polling for Receive 2007-09-08 00:56:02 [ndbd] INFO -- Watchdog: User time: 11231375 System time: 635323 2007-09-08 00:56:02 [ndbd] INFO -- Watchdog: User time: 11231376 System time: 635323 2007-09-08 00:56:02 [ndbd] WARNING -- Watchdog: Warning overslept 1259 ms, expected 100 ms. 2007-09-08 00:56:13 [ndbd] WARNING -- Ndb kernel is stuck in: Polling for Receive 2007-09-08 00:56:16 [ndbd] INFO -- Watchdog: User time: 11231382 System time: 635327 2007-09-08 00:56:16 [ndbd] INFO -- Watchdog: User time: 11231383 System time: 635328 2007-09-08 00:56:16 [ndbd] WARNING -- Watchdog: Warning overslept 3272 ms, expected 100 ms. 2007-09-08 00:56:37 [ndbd] WARNING -- Ndb kernel is stuck in: Polling for Receive 2007-09-08 00:56:46 [ndbd] INFO -- Watchdog: User time: 11231393 System time: 635333 2007-09-08 00:56:46 [ndbd] INFO -- Watchdog: User time: 11231393 System time: 635333 2007-09-08 00:56:46 [ndbd] WARNING -- Watchdog: Warning overslept 9022 ms, expected 100 ms. 2007-09-08 00:56:46 [ndbd] WARNING -- Ndb kernel is stuck in: Job Handling 2007-09-08 00:56:46 [ndbd] INFO -- Watchdog: User time: 11231393 System time: 635333 2007-09-08 00:56:47 [ndbd] INFO -- Arbitrator decided to shutdown this node 2007-09-08 00:56:47 [ndbd] INFO -- QMGR (Line: 4897) 0x0000000a 2007-09-08 00:56:47 [ndbd] INFO -- Error handler shutting down system 2007-09-08 00:56:47 [ndbd] INFO -- Error handler shutdown completed - exiting 2007-09-08 00:56:48 [ndbd] ALERT -- Node 2: Forced node shutdown completed. Caused by error 2305: 'Node lost connection to other nodes and can not form a unpartitioned cluster, please investigate if there are error(s) on other node(s)(Arbitration error). Temporary error, restart node'.