Current byte-offset of file-pointer is: 1566                      


Time: Wednesday 6 November 2013 - 09:30:20
Status: Temporary error, restart node
Message: Internal program error (failed ndbrequire) (Internal error, programming error or missing error message, please report a bug)
Error: 2341
Error data: Dbdict.cpp
Error object: DBDICT (Line: 25156) 0x00000002
Program: ndbd
Pid: 6583
Version: mysql-5.6.11 ndb-7.3.2
Trace: /usr/local/mysql/data/ndb_2_trace.log.1 [t1..t1]
***EOM***
                                                                                
Time: Wednesday 6 November 2013 - 10:16:46
Status: Temporary error, restart node
Message: Internal program error (failed ndbrequire) (Internal error, programming error or missing error message, please report a bug)
Error: 2341
Error data: Dbdict.cpp
Error object: DBDICT (Line: 25156) 0x00000002
Program: ndbd
Pid: 7243
Version: mysql-5.6.11 ndb-7.3.2
Trace: /usr/local/mysql/data/ndb_2_trace.log.2 [t1..t1]
***EOM***
                                                                                
Time: Wednesday 6 November 2013 - 10:32:00
Status: Permanent error, external action needed
Message: Failure to restore schema (Resource configuration error)
Error: 2355
Error data: Failed to recreate object 1573 during restart, error 21028.
Error object: DBDICT (Line: 4673) 0x00000002
Program: ndbd
Pid: 1723
Version: mysql-5.6.11 ndb-7.3.2
Trace: /usr/local/mysql/data/ndb_2_trace.log.3 [t1..t1]
***EOM***
                                                                                          
Time: Monday 30 September 2013 - 13:03:07
Status: Permanent error, external action needed
Message: Memory allocation failure, please decrease some configuration parameters (Configuration error)
Error: 2327
Error data: ArrayPool<T>::setSize malloc failed
Error object: /export/home/pb2/build/sb_0-9483450-1371111142.06/mysql-cluster-gpl-7.3.2/storage/ndb/src/kernel/vm
Program: ndbd
Pid: 1998
Version: mysql-5.6.11 ndb-7.3.2
Trace: /usr/local/mysql/data/ndb_2_trace.log.4 [t1..t1]
***EOM***
        
Time: Monday 30 September 2013 - 13:09:40
Status: Permanent error, external action needed
Message: Memory allocation failure, please decrease some configuration parameters (Configuration error)
Error: 2327
Error data: ArrayPool<T>::setSize malloc failed
Error object: /export/home/pb2/build/sb_0-9483450-1371111142.06/mysql-cluster-gpl-7.3.2/storage/ndb/src/kernel/vm
Program: ndbd
Pid: 2339
Version: mysql-5.6.11 ndb-7.3.2
Trace: /usr/local/mysql/data/ndb_2_trace.log.5 [t1..t1]
***EOM***
        
Time: Monday 30 September 2013 - 13:13:17
Status: Permanent error, external action needed
Message: Memory allocation failure, please decrease some configuration parameters (Configuration error)
Error: 2327
Error data: ArrayPool<T>::setSize malloc failed
Error object: /export/home/pb2/build/sb_0-9483450-1371111142.06/mysql-cluster-gpl-7.3.2/storage/ndb/src/kernel/vm
Program: ndbd
Pid: 2589
Version: mysql-5.6.11 ndb-7.3.2
Trace: /usr/local/mysql/data/ndb_2_trace.log.6 [t1..t1]
***EOM***
        
Time: Monday 30 September 2013 - 13:15:33
Status: Permanent error, external action needed
Message: Memory allocation failure, please decrease some configuration parameters (Configuration error)
Error: 2327
Error data: ArrayPool<T>::setSize malloc failed
Error object: /export/home/pb2/build/sb_0-9483450-1371111142.06/mysql-cluster-gpl-7.3.2/storage/ndb/src/kernel/vm
Program: ndbd
Pid: 2644
Version: mysql-5.6.11 ndb-7.3.2
Trace: /usr/local/mysql/data/ndb_2_trace.log.7 [t1..t1]
***EOM***
        
Time: Monday 30 September 2013 - 13:17:51
Status: Permanent error, external action needed
Message: Memory allocation failure, please decrease some configuration parameters (Configuration error)
Error: 2327
Error data: ArrayPool<T>::setSize malloc failed
Error object: /export/home/pb2/build/sb_0-9483450-1371111142.06/mysql-cluster-gpl-7.3.2/storage/ndb/src/kernel/vm
Program: ndbd
Pid: 2698
Version: mysql-5.6.11 ndb-7.3.2
Trace: /usr/local/mysql/data/ndb_2_trace.log.8 [t1..t1]
***EOM***
        
Time: Monday 30 September 2013 - 13:20:22
Status: Permanent error, external action needed
Message: Memory allocation failure, please decrease some configuration parameters (Configuration error)
Error: 2327
Error data: ArrayPool<T>::setSize malloc failed
Error object: /export/home/pb2/build/sb_0-9483450-1371111142.06/mysql-cluster-gpl-7.3.2/storage/ndb/src/kernel/vm
Program: ndbd
Pid: 2755
Version: mysql-5.6.11 ndb-7.3.2
Trace: /usr/local/mysql/data/ndb_2_trace.log.9 [t1..t1]
***EOM***
        
Time: Monday 30 September 2013 - 13:23:33
Status: Permanent error, external action needed
Message: Memory allocation failure, please decrease some configuration parameters (Configuration error)
Error: 2327
Error data: ArrayPool<T>::setSize malloc failed
Error object: /export/home/pb2/build/sb_0-9483450-1371111142.06/mysql-cluster-gpl-7.3.2/storage/ndb/src/kernel/vm
Program: ndbd
Pid: 2809
Version: mysql-5.6.11 ndb-7.3.2
Trace: /usr/local/mysql/data/ndb_2_trace.log.10 [t1..t1]
***EOM***
       
Time: Monday 30 September 2013 - 13:26:21
Status: Permanent error, external action needed
Message: Memory allocation failure, please decrease some configuration parameters (Configuration error)
Error: 2327
Error data: ArrayPool<T>::setSize malloc failed
Error object: /export/home/pb2/build/sb_0-9483450-1371111142.06/mysql-cluster-gpl-7.3.2/storage/ndb/src/kernel/vm
Program: ndbd
Pid: 2863
Version: mysql-5.6.11 ndb-7.3.2
Trace: /usr/local/mysql/data/ndb_2_trace.log.11 [t1..t1]
***EOM***
       
Time: Monday 30 September 2013 - 13:29:17
Status: Permanent error, external action needed
Message: Memory allocation failure, please decrease some configuration parameters (Configuration error)
Error: 2327
Error data: ArrayPool<T>::setSize malloc failed
Error object: /export/home/pb2/build/sb_0-9483450-1371111142.06/mysql-cluster-gpl-7.3.2/storage/ndb/src/kernel/vm
Program: ndbd
Pid: 2918
Version: mysql-5.6.11 ndb-7.3.2
Trace: /usr/local/mysql/data/ndb_2_trace.log.12 [t1..t1]
***EOM***
       
Time: Monday 30 September 2013 - 13:41:02
Status: Permanent error, external action needed
Message: Memory allocation failure, please decrease some configuration parameters (Configuration error)
Error: 2327
Error data: ArrayPool<T>::setSize malloc failed
Error object: /export/home/pb2/build/sb_0-9483450-1371111142.06/mysql-cluster-gpl-7.3.2/storage/ndb/src/kernel/vm
Program: ndbd
Pid: 2982
Version: mysql-5.6.11 ndb-7.3.2
Trace: /usr/local/mysql/data/ndb_2_trace.log.13 [t1..t1]
***EOM***
       
Time: Monday 30 September 2013 - 13:44:40
Status: Permanent error, external action needed
Message: Memory allocation failure, please decrease some configuration parameters (Configuration error)
Error: 2327
Error data: ArrayPool<T>::setSize malloc failed
Error object: /export/home/pb2/build/sb_0-9483450-1371111142.06/mysql-cluster-gpl-7.3.2/storage/ndb/src/kernel/vm
Program: ndbd
Pid: 3036
Version: mysql-5.6.11 ndb-7.3.2
Trace: /usr/local/mysql/data/ndb_2_trace.log.14 [t1..t1]
***EOM***
       
Time: Monday 30 September 2013 - 13:47:10
Status: Permanent error, external action needed
Message: Memory allocation failure, please decrease some configuration parameters (Configuration error)
Error: 2327
Error data: ArrayPool<T>::setSize malloc failed
Error object: /export/home/pb2/build/sb_0-9483450-1371111142.06/mysql-cluster-gpl-7.3.2/storage/ndb/src/kernel/vm
Program: ndbd
Pid: 3090
Version: mysql-5.6.11 ndb-7.3.2
Trace: /usr/local/mysql/data/ndb_2_trace.log.15 [t1..t1]
***EOM***
       
Time: Monday 30 September 2013 - 14:01:14
Status: Permanent error, external action needed
Message: Memory allocation failure, please decrease some configuration parameters (Configuration error)
Error: 2327
Error data: ArrayPool<T>::setSize malloc failed
Error object: /export/home/pb2/build/sb_0-9483450-1371111142.06/mysql-cluster-gpl-7.3.2/storage/ndb/src/kernel/vm
Program: ndbd
Pid: 3154
Version: mysql-5.6.11 ndb-7.3.2
Trace: /usr/local/mysql/data/ndb_2_trace.log.16 [t1..t1]
***EOM***
       
Time: Monday 30 September 2013 - 14:59:59
Status: Permanent error, external action needed
Message: Memory allocation failure, please decrease some configuration parameters (Configuration error)
Error: 2327
Error data: ArrayPool<T>::setSize malloc failed
Error object: /export/home/pb2/build/sb_0-9483450-1371111142.06/mysql-cluster-gpl-7.3.2/storage/ndb/src/kernel/vm
Program: ndbd
Pid: 1802
Version: mysql-5.6.11 ndb-7.3.2
Trace: /usr/local/mysql/data/ndb_2_trace.log.17 [t1..t1]
***EOM***
       
Time: Tuesday 1 October 2013 - 05:34:51
Status: Permanent error, external action needed
Message: Memory allocation failure, please decrease some configuration parameters (Configuration error)
Error: 2327
Error data: DBTUP could not allocate memory for Fragrecord
Error object: Requested: 288x472466195 = 136070264160 bytes
Program: ndbd
Pid: 1413
Version: mysql-5.6.11 ndb-7.3.2
Trace: /usr/local/mysql/data/ndb_2_trace.log.18 [t1..t1]
***EOM***
                                                    
Time: Tuesday 1 October 2013 - 05:36:33
Status: Permanent error, external action needed
Message: Memory allocation failure, please decrease some configuration parameters (Configuration error)
Error: 2327
Error data: DBTUP could not allocate memory for Fragrecord
Error object: Requested: 288x472466195 = 136070264160 bytes
Program: ndbd
Pid: 1661
Version: mysql-5.6.11 ndb-7.3.2
Trace: /usr/local/mysql/data/ndb_2_trace.log.19 [t1..t1]
***EOM***
                                                    
Time: Tuesday 1 October 2013 - 06:08:26
Status: Permanent error, external action needed
Message: Memory allocation failure, please decrease some configuration parameters (Configuration error)
Error: 2327
Error data: DBTUP could not allocate memory for Fragrecord
Error object: Requested: 288x3670034822 = 1056970028736 bytes
Program: ndbd
Pid: 1214
Version: mysql-5.6.11 ndb-7.3.2
Trace: /usr/local/mysql/data/ndb_2_trace.log.20 [t1..t1]
***EOM***
                                                  
Time: Tuesday 1 October 2013 - 06:13:24
Status: Permanent error, external action needed
Message: Memory allocation failure, please decrease some configuration parameters (Configuration error)
Error: 2327
Error data: DBTUP could not allocate memory for Fragrecord
Error object: Requested: 288x3670034822 = 1056970028736 bytes
Program: ndbd
Pid: 1270
Version: mysql-5.6.11 ndb-7.3.2
Trace: /usr/local/mysql/data/ndb_2_trace.log.21 [t1..t1]
***EOM***
                                                  
Time: Tuesday 1 October 2013 - 06:14:21
Status: Permanent error, external action needed
Message: Memory allocation failure, please decrease some configuration parameters (Configuration error)
Error: 2327
Error data: DBTUP could not allocate memory for Fragrecord
Error object: Requested: 288x3145745922 = 905974825536 bytes
Program: ndbd
Pid: 1333
Version: mysql-5.6.11 ndb-7.3.2
Trace: /usr/local/mysql/data/ndb_2_trace.log.22 [t1..t1]
***EOM***
                                                   
Time: Tuesday 1 October 2013 - 06:23:36
Status: Permanent error, external action needed
Message: Memory allocation failure, please decrease some configuration parameters (Configuration error)
Error: 2327
Error data: DBTUP could not allocate memory for Fragrecord
Error object: Requested: 288x1992314322 = 573786524736 bytes
Program: ndbd
Pid: 1681
Version: mysql-5.6.11 ndb-7.3.2
Trace: /usr/local/mysql/data/ndb_2_trace.log.23 [t1..t1]
***EOM***
                                                   
Time: Tuesday 1 October 2013 - 06:26:45
Status: Permanent error, external action needed
Message: Memory allocation failure, please decrease some configuration parameters (Configuration error)
Error: 2327
Error data: DBTUP could not allocate memory for Fragrecord
Error object: Requested: 288x1992314322 = 573786524736 bytes
Program: ndbd
Pid: 1788
Version: mysql-5.6.11 ndb-7.3.2
Trace: /usr/local/mysql/data/ndb_2_trace.log.24 [t1..t1]
***EOM***
                                                   
Time: Tuesday 1 October 2013 - 06:28:23
Status: Permanent error, external action needed
Message: Memory allocation failure, please decrease some configuration parameters (Configuration error)
Error: 2327
Error data: DBTUP could not allocate memory for Fragrecord
Error object: Requested: 288x1992314322 = 573786524736 bytes
Program: ndbd
Pid: 1856
Version: mysql-5.6.11 ndb-7.3.2
Trace: /usr/local/mysql/data/ndb_2_trace.log.25 [t1..t1]
***EOM***