{\rtf1\ansi\ansicpg949\cocoartf1187\cocoasubrtf340 {\fonttbl\f0\fswiss\fcharset0 Helvetica;} {\colortbl;\red255\green255\blue255;} \paperw11900\paperh16840\margl1440\margr1440\vieww17160\viewh13500\viewkind0 \pard\tx566\tx1133\tx1700\tx2267\tx2834\tx3401\tx3968\tx4535\tx5102\tx5669\tx6236\tx6803\pardirnatural \f0\fs24 \cf0 2012-10-23 19:54:25 [MgmtSrvr] INFO -- Node 5: Local checkpoint 108 started. Keep GCI = 253938 oldest restorable GCI = 253986\ 2012-10-23 19:56:26 [MgmtSrvr] INFO -- Node 5: Local checkpoint 108 completed\ 2012-10-23 20:52:21 [MgmtSrvr] INFO -- Node 5: Local checkpoint 109 started. Keep GCI = 255844 oldest restorable GCI = 255892\ 2012-10-23 20:54:23 [MgmtSrvr] INFO -- Node 5: Local checkpoint 109 completed\ 2012-10-23 21:47:17 [MgmtSrvr] INFO -- Node 5: Local checkpoint 110 started. Keep GCI = 257530 oldest restorable GCI = 257579\ 2012-10-23 21:49:19 [MgmtSrvr] INFO -- Node 5: Local checkpoint 110 completed\ 2012-10-23 22:37:13 [MgmtSrvr] INFO -- Node 5: Local checkpoint 111 started. Keep GCI = 259128 oldest restorable GCI = 259177\ 2012-10-23 22:39:19 [MgmtSrvr] INFO -- Node 5: Local checkpoint 111 completed\ 2012-10-23 23:24:25 [MgmtSrvr] INFO -- Node 5: Local checkpoint 112 started. Keep GCI = 260580 oldest restorable GCI = 260631\ 2012-10-23 23:26:35 [MgmtSrvr] INFO -- Node 5: Local checkpoint 112 completed\ 2012-10-24 00:07:38 [MgmtSrvr] INFO -- Node 24: Event buffer status: used=3744B(0%) alloc=3220KB(0%) max=0B apply_epoch=263211/19 latest_epoch=263212/0\ 2012-10-24 00:10:06 [MgmtSrvr] INFO -- Node 5: Local checkpoint 113 started. Keep GCI = 261953 oldest restorable GCI = 262005\ 2012-10-24 00:12:15 [MgmtSrvr] INFO -- Node 5: Local checkpoint 113 completed\ 2012-10-24 00:59:48 [MgmtSrvr] INFO -- Node 5: Local checkpoint 114 started. Keep GCI = 263282 oldest restorable GCI = 263335\ 2012-10-24 01:01:56 [MgmtSrvr] INFO -- Node 5: Local checkpoint 114 completed\ 2012-10-24 01:32:00 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265667/3\ 2012-10-24 01:32:00 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265667/4\ 2012-10-24 01:32:00 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265667/5\ 2012-10-24 01:32:00 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265667/6\ 2012-10-24 01:32:01 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265667/7\ 2012-10-24 01:32:01 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265667/8\ 2012-10-24 01:32:01 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265667/9\ 2012-10-24 01:32:01 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265667/10\ 2012-10-24 01:32:01 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265667/11\ 2012-10-24 01:32:01 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265667/12\ 2012-10-24 01:32:01 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265667/13\ 2012-10-24 01:32:01 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265667/14\ 2012-10-24 01:32:01 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265667/15\ 2012-10-24 01:32:02 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265667/16\ 2012-10-24 01:32:02 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265667/17\ 2012-10-24 01:32:02 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265667/18\ 2012-10-24 01:32:02 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265667/19\ 2012-10-24 01:32:02 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265668/0\ 2012-10-24 01:32:02 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265668/1\ 2012-10-24 01:32:02 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265668/2\ 2012-10-24 01:32:02 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265668/3\ 2012-10-24 01:32:02 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265668/4\ 2012-10-24 01:32:02 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265668/5\ 2012-10-24 01:32:03 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265668/6\ 2012-10-24 01:32:03 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265668/7\ 2012-10-24 01:32:03 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265668/8\ 2012-10-24 01:32:03 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265668/9\ 2012-10-24 01:32:03 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265668/10\ 2012-10-24 01:32:03 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265668/11\ 2012-10-24 01:32:03 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265668/12\ 2012-10-24 01:32:03 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265668/13\ 2012-10-24 01:32:03 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265668/14\ 2012-10-24 01:32:03 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265668/15\ 2012-10-24 01:32:04 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265668/16\ 2012-10-24 01:32:04 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265668/17\ 2012-10-24 01:32:04 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265668/18\ 2012-10-24 01:32:04 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265668/19\ 2012-10-24 01:32:04 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265669/0\ 2012-10-24 01:32:04 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265669/1\ 2012-10-24 01:32:04 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265669/2\ 2012-10-24 01:32:04 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265669/3\ 2012-10-24 01:32:04 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265669/4\ 2012-10-24 01:32:04 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265669/5\ 2012-10-24 01:32:05 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265669/6\ 2012-10-24 01:32:05 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265669/7\ 2012-10-24 01:32:05 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265669/8\ 2012-10-24 01:32:05 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265669/9\ 2012-10-24 01:32:05 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265669/10\ 2012-10-24 01:32:05 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265669/11\ 2012-10-24 01:32:05 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265669/12\ 2012-10-24 01:32:05 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265669/13\ 2012-10-24 01:32:05 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265669/14\ 2012-10-24 01:32:05 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265669/15\ 2012-10-24 01:32:06 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265669/16\ 2012-10-24 01:32:06 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265669/17\ 2012-10-24 01:32:06 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265669/18\ 2012-10-24 01:32:06 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265669/19\ 2012-10-24 01:32:06 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265670/0\ 2012-10-24 01:32:06 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265670/1\ 2012-10-24 01:32:06 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265670/2\ 2012-10-24 01:32:06 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265670/3\ 2012-10-24 01:32:06 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265670/4\ 2012-10-24 01:32:07 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265670/5\ 2012-10-24 01:32:07 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265670/6\ 2012-10-24 01:32:07 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265670/7\ 2012-10-24 01:32:07 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265670/8\ 2012-10-24 01:32:07 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265670/9\ 2012-10-24 01:32:07 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265670/10\ 2012-10-24 01:32:07 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265670/11\ 2012-10-24 01:32:07 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265670/12\ 2012-10-24 01:32:07 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265670/13\ 2012-10-24 01:32:07 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265670/14\ 2012-10-24 01:32:08 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265670/15\ 2012-10-24 01:32:08 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265670/16\ 2012-10-24 01:32:08 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265670/17\ 2012-10-24 01:32:08 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265670/18\ 2012-10-24 01:32:08 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265670/19\ 2012-10-24 01:32:08 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265671/0\ 2012-10-24 01:32:08 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265671/1\ 2012-10-24 01:32:08 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265671/2\ 2012-10-24 01:32:08 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265671/3\ 2012-10-24 01:32:08 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265671/4\ 2012-10-24 01:32:09 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265671/5\ 2012-10-24 01:32:09 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265671/6\ 2012-10-24 01:32:09 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265671/7\ 2012-10-24 01:32:09 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265671/8\ 2012-10-24 01:32:09 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265671/9\ 2012-10-24 01:32:09 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265671/10\ 2012-10-24 01:32:09 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265671/11\ 2012-10-24 01:32:09 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265671/12\ 2012-10-24 01:32:09 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265671/13\ 2012-10-24 01:32:09 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265671/14\ 2012-10-24 01:32:10 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265671/15\ 2012-10-24 01:32:10 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265671/16\ 2012-10-24 01:32:10 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265671/17\ 2012-10-24 01:32:10 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265671/18\ 2012-10-24 01:32:10 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265671/19\ 2012-10-24 01:32:10 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265672/0\ 2012-10-24 01:32:10 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265672/1\ 2012-10-24 01:32:10 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265672/2\ 2012-10-24 01:32:10 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265672/3\ 2012-10-24 01:32:10 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265672/4\ 2012-10-24 01:32:11 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265672/5\ 2012-10-24 01:32:11 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265672/62012-10-24 01:32:11 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265672/7\ 2012-10-24 01:32:11 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265672/8\ 2012-10-24 01:32:11 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265672/9\ 2012-10-24 01:32:11 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265672/10\ 2012-10-24 01:32:11 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265672/11\ 2012-10-24 01:32:11 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265672/12\ 2012-10-24 01:32:11 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265672/13\ 2012-10-24 01:32:12 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265672/14\ 2012-10-24 01:32:12 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265672/15\ 2012-10-24 01:32:12 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265672/16\ 2012-10-24 01:32:12 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265672/17\ 2012-10-24 01:32:12 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265672/18\ 2012-10-24 01:32:12 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265672/19\ 2012-10-24 01:32:12 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265673/0\ 2012-10-24 01:32:12 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265673/1\ 2012-10-24 01:32:12 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265673/2\ 2012-10-24 01:32:12 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265673/3\ 2012-10-24 01:32:13 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265673/4\ 2012-10-24 01:32:13 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265673/5\ 2012-10-24 01:32:13 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265673/6\ 2012-10-24 01:32:13 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265673/7\ 2012-10-24 01:32:13 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265673/8\ 2012-10-24 01:32:13 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265673/9\ 2012-10-24 01:32:13 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265673/10\ 2012-10-24 01:32:13 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265673/11\ 2012-10-24 01:32:13 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265673/12\ 2012-10-24 01:32:13 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265673/13\ 2012-10-24 01:32:14 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265673/14\ 2012-10-24 01:32:14 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265673/15\ 2012-10-24 01:32:14 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265673/16\ 2012-10-24 01:32:14 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265673/17\ 2012-10-24 01:32:14 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265673/18\ 2012-10-24 01:32:14 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265673/19\ 2012-10-24 01:32:14 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265674/0\ 2012-10-24 01:32:14 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265674/1\ 2012-10-24 01:32:14 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265674/2\ 2012-10-24 01:32:14 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265674/3\ 2012-10-24 01:32:15 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265674/4\ 2012-10-24 01:32:15 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265674/5\ 2012-10-24 01:32:15 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265674/6\ 2012-10-24 01:32:15 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=445KB(0%) max=0B apply_epoch=265667/0 latest_epoch=265674/7\ 2012-10-24 01:59:58 [MgmtSrvr] INFO -- Node 5: Local checkpoint 115 started. Keep GCI = 264728 oldest restorable GCI = 264779\ 2012-10-24 02:02:01 [MgmtSrvr] INFO -- Node 5: Local checkpoint 115 completed\ 2012-10-24 02:47:13 [MgmtSrvr] INFO -- Node 30: Event buffer status: used=288B(0%) alloc=446KB(0%) max=0B apply_epoch=267857/18 latest_epoch=267858/0\ 2012-10-24 03:35:36 [MgmtSrvr] INFO -- Node 5: Local checkpoint 116 started. Keep GCI = 266480 oldest restorable GCI = 266529\ 2012-10-24 03:36:50 [MgmtSrvr] WARNING -- Node 5: LCP Frag watchdog : No progress on table 68, frag 0 for 20 s. 839488 rows completed\ 2012-10-24 03:36:57 [MgmtSrvr] WARNING -- Node 8: LCP Frag watchdog : No progress on table 68, frag 5 for 20 s. 839504 rows completed\ 2012-10-24 03:37:00 [MgmtSrvr] WARNING -- Node 5: LCP Frag watchdog : No progress on table 68, frag 0 for 30 s. 839488 rows completed\ 2012-10-24 03:37:00 [MgmtSrvr] WARNING -- Node 7: LCP Frag watchdog : No progress on table 68, frag 5 for 20 s. 839504 rows completed\ 2012-10-24 03:37:07 [MgmtSrvr] WARNING -- Node 8: LCP Frag watchdog : No progress on table 68, frag 5 for 30 s. 839504 rows completed\ 2012-10-24 03:37:08 [MgmtSrvr] INFO -- Node 25: Event buffer status: used=432B(0%) alloc=437KB(0%) max=0B apply_epoch=269311/19 latest_epoch=269312/0\ 2012-10-24 03:37:10 [MgmtSrvr] WARNING -- Node 5: LCP Frag watchdog : No progress on table 68, frag 0 for 40 s. 839488 rows completed\ 2012-10-24 03:37:10 [MgmtSrvr] WARNING -- Node 7: LCP Frag watchdog : No progress on table 68, frag 5 for 30 s. 839504 rows completed\ 2012-10-24 03:37:17 [MgmtSrvr] WARNING -- Node 8: LCP Frag watchdog : No progress on table 68, frag 5 for 40 s. 839504 rows completed\ 2012-10-24 03:37:20 [MgmtSrvr] WARNING -- Node 5: LCP Frag watchdog : No progress on table 68, frag 0 for 50 s. 839488 rows completed\ 2012-10-24 03:37:20 [MgmtSrvr] WARNING -- Node 7: LCP Frag watchdog : No progress on table 68, frag 5 for 40 s. 839504 rows completed\ 2012-10-24 03:37:27 [MgmtSrvr] WARNING -- Node 8: LCP Frag watchdog : No progress on table 68, frag 5 for 50 s. 839504 rows completed\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: BackupRecord 0: BackupId: 116 MasterRef: 6f70005 ClientRef: 0\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: State: 5\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: file 0: type: 3 flags: H'0\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: Backup - dump pool sizes\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: BackupPool: 2 BackupFilePool: 4 TablePool: 2203\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: AttrPool: 2 TriggerPool: 4 FragmentPool: 2203\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: PagePool: 16395\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: -- Node 5 LCP STATE --\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: lcpStatus = 8 (update place = 13152)\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: lcpStart = 0 lcpStopGcp = 269297 keepGci = 266480 oldestRestorable = 266529\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: immediateLcpStart = 0 masterLcpNodeId = 5\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: 0 : status: 2 place: 11173\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: 1 : status: 6 place: 10999\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: 2 : status: 5 place: 811\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: 3 : status: 5 place: 13076\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: 4 : status: 4 place: 12898\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: 5 : status: 7 place: 12882\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: 6 : status: 1 place: 12806\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: 7 : status: 0 place: 12855\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: 8 : status: 1 place: 12806\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: 9 : status: 0 place: 12855\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: -- Node 5 LCP STATE --\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: ParticipatingDIH = 00000000000001a0\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: ParticipatingLQH = 00000000000001a0\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: m_LCP_COMPLETE_REP_Counter_DIH = [SignalCounter: m_count=3 00000000000001a0]\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: m_LCP_COMPLETE_REP_Counter_LQH = [SignalCounter: m_count=3 00000000000001a0]\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: m_LAST_LCP_FRAG_ORD = [SignalCounter: m_count=3 00000000000001a0]\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: m_LCP_COMPLETE_REP_From_Master_Received = 0\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: Node 5: started: table=68 fragment=0 replica=2112\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: Node 5: started: table=68 fragment=2 replica=2117\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: Node 5: queued: table=68 fragment=4 replica=2120\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: Node 5: queued: table=68 fragment=6 replica=2125\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: Node 7: started: table=68 fragment=5 replica=2122\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: Node 7: started: table=68 fragment=7 replica=2127\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: Node 7: queued: table=68 fragment=9 replica=2130\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: Node 7: queued: table=68 fragment=11 replica=2135\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: Node 8: started: table=68 fragment=5 replica=2123\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: Node 8: started: table=68 fragment=7 replica=2126\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: Node 8: queued: table=68 fragment=9 replica=2131\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: Node 8: queued: table=68 fragment=11 replica=2134\ 2012-10-24 03:37:30 [MgmtSrvr] WARNING -- Node 5: LCP Frag watchdog : No progress on table 68, frag 0 for 60 s. 839488 rows completed\ 2012-10-24 03:37:30 [MgmtSrvr] WARNING -- Node 5: LCP Frag watchdog : Checkpoint of table 68 fragment 0 too slow (no progress for > 60 s).\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: == LQH LCP STATE ==\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: clcpCompletedState=1, c_lcpId=116, cnoOfFragsCheckpointed=54\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: lcpState=7 lastFragmentFlag=0\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: currentFragment.fragPtrI=132\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: currentFragment.lcpFragOrd.tableId=68\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: lcpQueued=1 reportEmpty=0\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: m_EMPTY_LCP_REQ=0000000000000000\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: BackupRecord 0: BackupId: 116 MasterRef: 2f70005 ClientRef: 0\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: State: 4\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: file 0: type: 3 flags: H'19\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: Backup - dump pool sizes\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: BackupPool: 2 BackupFilePool: 4 TablePool: 2203\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: AttrPool: 2 TriggerPool: 4 FragmentPool: 2203\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: PagePool: 16395\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: BackupRecord 0: BackupId: 116 MasterRef: 4f70005 ClientRef: 0\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: State: 5\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: file 0: type: 3 flags: H'0\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: Backup - dump pool sizes\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: BackupPool: 2 BackupFilePool: 4 TablePool: 2203\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: AttrPool: 2 TriggerPool: 4 FragmentPool: 2203\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: PagePool: 16395\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: BackupRecord 0: BackupId: 116 MasterRef: 8f70005 ClientRef: 0\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: State: 5\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: file 0: type: 3 flags: H'0\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: Backup - dump pool sizes\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: BackupPool: 2 BackupFilePool: 4 TablePool: 2203\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: AttrPool: 2 TriggerPool: 4 FragmentPool: 2203\ 2012-10-24 03:37:30 [MgmtSrvr] INFO -- Node 5: PagePool: 16395\ 2012-10-24 03:37:30 [MgmtSrvr] WARNING -- Node 7: LCP Frag watchdog : No progress on table 68, frag 5 for 50 s. 839504 rows completed\ 2012-10-24 03:37:37 [MgmtSrvr] ALERT -- Node 5: Forced node shutdown completed. Caused by error 7200: 'LCP fragment scan watchdog detected a problem. Please report a bug.(Internal error, programming error or missing error message, please report a bug). Temporary error, restart node'.\ 2012-10-24 03:37:37 [MgmtSrvr] ALERT -- Node 2: Node 5 Disconnected\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: BackupRecord 0: BackupId: 116 MasterRef: 2f70008 ClientRef: 0\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: State: 5\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: file 0: type: 3 flags: H'0\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: Backup - dump pool sizes\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: BackupPool: 2 BackupFilePool: 4 TablePool: 2203\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: AttrPool: 2 TriggerPool: 4 FragmentPool: 2203\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: PagePool: 16395\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: BackupRecord 0: BackupId: 116 MasterRef: 6f70008 ClientRef: 0\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: State: 5\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: file 0: type: 3 flags: H'0\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: Backup - dump pool sizes\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: BackupPool: 2 BackupFilePool: 4 TablePool: 2203\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: AttrPool: 2 TriggerPool: 4 FragmentPool: 2203\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: PagePool: 16395\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: BackupRecord 0: BackupId: 116 MasterRef: 8f70008 ClientRef: 0\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: State: 5\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: file 0: type: 3 flags: H'0\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: Backup - dump pool sizes\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: BackupPool: 2 BackupFilePool: 4 TablePool: 2203\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: AttrPool: 2 TriggerPool: 4 FragmentPool: 2203\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: PagePool: 16395\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: -- Node 8 LCP STATE --\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: lcpStatus = 2 (update place = 11173)\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: lcpStart = 0 lcpStopGcp = 269297 keepGci = 0 oldestRestorable = 0\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: immediateLcpStart = 0 masterLcpNodeId = 5\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: 0 : status: 6 place: 10999\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: 1 : status: 5 place: 811\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: 2 : status: 0 place: 14102\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: 3 : status: 10 place: 13911\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: 4 : status: 9 place: 13530\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: 5 : status: 2 place: 11173\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: 6 : status: 6 place: 10999\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: 7 : status: 5 place: 811\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: 8 : status: 0 place: 14102\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: 9 : status: 10 place: 13911\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: -- Node 8 LCP STATE --\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: ParticipatingDIH = 00000000000001a0\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: ParticipatingLQH = 00000000000001a0\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: m_LCP_COMPLETE_REP_Counter_DIH = [SignalCounter: m_count=0 0000000000000000]\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: m_LCP_COMPLETE_REP_Counter_LQH = [SignalCounter: m_count=3 00000000000001a0]\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: m_LAST_LCP_FRAG_ORD = [SignalCounter: m_count=0 0000000000000000]\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: m_LCP_COMPLETE_REP_From_Master_Received = 0\ 2012-10-24 03:37:37 [MgmtSrvr] WARNING -- Node 8: LCP Frag watchdog : No progress on table 68, frag 5 for 60 s. 839504 rows completed\ 2012-10-24 03:37:37 [MgmtSrvr] WARNING -- Node 8: LCP Frag watchdog : Checkpoint of table 68 fragment 5 too slow (no progress for > 60 s).\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: == LQH LCP STATE ==\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: clcpCompletedState=1, c_lcpId=116, cnoOfFragsCheckpointed=54\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: lcpState=7 lastFragmentFlag=0\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: currentFragment.fragPtrI=132\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: currentFragment.lcpFragOrd.tableId=68\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: lcpQueued=1 reportEmpty=0\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: m_EMPTY_LCP_REQ=0000000000000000\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: BackupRecord 0: BackupId: 116 MasterRef: 4f70008 ClientRef: 0\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: State: 4\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: file 0: type: 3 flags: H'19\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: Backup - dump pool sizes\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: BackupPool: 2 BackupFilePool: 4 TablePool: 2203\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: AttrPool: 2 TriggerPool: 4 FragmentPool: 2203\ 2012-10-24 03:37:37 [MgmtSrvr] INFO -- Node 8: PagePool: 16395\ 2012-10-24 03:37:38 [MgmtSrvr] ALERT -- Node 2: Node 6 Disconnected\ 2012-10-24 03:37:38 [MgmtSrvr] ALERT -- Node 6: Forced node shutdown completed. Occured during startphase 1. Caused by error 2308: 'Another node failed during system restart, please investigate error(s) on other node(s)(Restart error). Temporary error, restart node'.\ 2012-10-24 03:37:39 [MgmtSrvr] ALERT -- Node 7: Node 5 Disconnected\ 2012-10-24 03:37:39 [MgmtSrvr] INFO -- Node 7: Communication to Node 5 closed\ 2012-10-24 03:37:39 [MgmtSrvr] INFO -- Node 8: Communication to Node 5 closed\ 2012-10-24 03:37:39 [MgmtSrvr] ALERT -- Node 8: Node 5 Disconnected\ 2012-10-24 03:37:39 [MgmtSrvr] INFO -- Node 8: Communication to Node 5 closed\ 2012-10-24 03:37:41 [MgmtSrvr] ALERT -- Node 7: Forced node shutdown completed. Caused by error 2305: 'Node lost connection to other nodes and can not form a unpartitioned cluster, please investigate if there are error(s) on other node(s)(Arbitration error). Temporary error, restart node'.\ 2012-10-24 03:37:41 [MgmtSrvr] ALERT -- Node 2: Node 7 Disconnected\ 2012-10-24 03:37:42 [MgmtSrvr] ALERT -- Node 8: Node 7 Disconnected\ 2012-10-24 03:37:46 [MgmtSrvr] ALERT -- Node 8: Forced node shutdown completed. Caused by error 2305: 'Node lost connection to other nodes and can not form a unpartitioned cluster, please investigate if there are error(s) on other node(s)(Arbitration error). Temporary error, restart node'.\ 2012-10-24 03:37:46 [MgmtSrvr] ALERT -- Node 2: Node 8 Disconnected}