Bug #69114 Pointer too large, Error: 2306
Submitted: 1 May 2013 17:36 Modified: 3 Jun 2013 13:02
Reporter: Ben Im Email Updates:
Status: No Feedback Impact on me:
None 
Category:MySQL Cluster: Cluster (NDB) storage engine Severity:S2 (Serious)
Version:7.3.0 OS:Linux (ubuntu 12.04.01)
Assigned to: CPU Architecture:Any

[1 May 2013 17:36] Ben Im
Description:
NDB data node crashed. Attached 

-rw-r--r-- 1 root root       1 Apr 30 13:22 ndb_4_trace.log.next
-rw-r--r-- 1 root root     568 May  1 10:19 ndb-error-2306
-rw-r--r-- 1 root root   79447 May  1 10:21 ndb-out-2306
-rw-r--r-- 1 root root 1259049 May  1 10:22 ndb-trace-2306.1

and ndb_error_reporter output. By the way, I keep running into below error message when I run ndb_error_reporter. Is this ok, or what am I doing wrong?

Thanks,
Ben

root@TB-119-NDB:/usr/local/mysql/bin# ./ndb_error_reporter /usr/local/mysql/
Can't exec "ndb_config": No such file or directory at ./ndb_error_reporter line 49.
Use of uninitialized value in split at ./ndb_error_reporter line 49.
Can't exec "ndb_config": No such file or directory at ./ndb_error_reporter line 51.
Use of uninitialized value in split at ./ndb_error_reporter line 51.

 Copying configuration file...

        /usr/local/mysql/

cp: omitting directory `/usr/local/mysql/'

Please attach ndb_error_report_20130501102528.tar.bz2 to your error report

How to repeat:
Randomly happens.
[2 May 2013 6:58] Gustaf Thorslund
Hi Ben,

You need to have ndb_config in your path. It's located in same directory as ndb_error_reporter. A correct output would look something like:

$ ndb_error_reporter config.ini

 Copying data from node 3

ndb_3_error.log                                                                                                             100% 5059     4.9KB/s   00:00    
scp: /space1/test/ndbd/ndb_3_fs: not a regular file
ndb_3_out.log                                                                                                               100%  431KB 431.2KB/s   00:00    
ndb_3.pid                                                                                                                   100%    5     0.0KB/s   00:00    
ndb_3_trace.log.1                                                                                                           100%    0     0.0KB/s   00:00    
ndb_3_trace.log.10                                                                                                          100%  734KB 733.7KB/s   00:00    
ndb_3_trace.log.2                                                                                                           100%    0     0.0KB/s   00:00    
ndb_3_trace.log.3                                                                                                           100%    0     0.0KB/s   00:00    
ndb_3_trace.log.4                                                                                                           100%    0     0.0KB/s   00:00    
ndb_3_trace.log.5                                                                                                           100%    0     0.0KB/s   00:00    
ndb_3_trace.log.6                                                                                                           100%    0     0.0KB/s   00:00    
ndb_3_trace.log.7                                                                                                           100%  951KB 950.8KB/s   00:00    
ndb_3_trace.log.8                                                                                                           100%  948KB 948.4KB/s   00:00    
ndb_3_trace.log.9                                                                                                           100%    0     0.0KB/s   00:00    
ndb_3_trace.log.next                                                                                                        100%    2     0.0KB/s   00:00    

 Copying data from node 4

ndb_4_error.log                                                                                                             100% 9550     9.3KB/s   00:00    
scp: /space1/test/ndbd/ndb_4_fs: not a regular file
ndb_4_out.log                                                                                                               100%  332KB 332.2KB/s   00:00    
ndb_4.pid                                                                                                                   100%    5     0.0KB/s   00:00    
ndb_4_trace.log.1                                                                                                           100%    0     0.0KB/s   00:00    
ndb_4_trace.log.10                                                                                                          100%    0     0.0KB/s   00:00    
ndb_4_trace.log.11                                                                                                          100%    0     0.0KB/s   00:00    
ndb_4_trace.log.12                                                                                                          100%    0     0.0KB/s   00:00    
ndb_4_trace.log.13                                                                                                          100%    0     0.0KB/s   00:00    
ndb_4_trace.log.14                                                                                                          100%    0     0.0KB/s   00:00    
ndb_4_trace.log.15                                                                                                          100%  945KB 945.4KB/s   00:00    
ndb_4_trace.log.16                                                                                                          100%  946KB 945.5KB/s   00:00    
ndb_4_trace.log.17                                                                                                          100%    0     0.0KB/s   00:00    
ndb_4_trace.log.18                                                                                                          100%    0     0.0KB/s   00:00    
ndb_4_trace.log.19                                                                                                          100% 1066KB   1.0MB/s   00:00    
ndb_4_trace.log.2                                                                                                           100%    0     0.0KB/s   00:00    
ndb_4_trace.log.3                                                                                                           100%    0     0.0KB/s   00:00    
ndb_4_trace.log.4                                                                                                           100%    0     0.0KB/s   00:00    
ndb_4_trace.log.5                                                                                                           100%    0     0.0KB/s   00:00    
ndb_4_trace.log.6                                                                                                           100%    0     0.0KB/s   00:00    
ndb_4_trace.log.7                                                                                                           100%    0     0.0KB/s   00:00    
ndb_4_trace.log.8                                                                                                           100%    0     0.0KB/s   00:00    
ndb_4_trace.log.9                                                                                                           100%    0     0.0KB/s   00:00    
ndb_4_trace.log.next                                                                                                        100%    2     0.0KB/s   00:00    

 Copying data from node 1

ndb_1_cluster.log                                                                                                           100%   94KB  94.4KB/s   00:00    
ndb_1_cluster.log.1                                                                                                         100%  977KB 976.7KB/s   00:00    
ndb_1_cluster.log.2                                                                                                         100%  977KB 976.9KB/s   00:00    
ndb_1_cluster.log.3                                                                                                         100%  977KB 976.8KB/s   00:00    
ndb_1_cluster.log.4                                                                                                         100%  977KB 976.8KB/s   00:00    
ndb_1_cluster.log.5                                                                                                         100%  977KB 976.7KB/s   00:00    
ndb_1_out.log                                                                                                               100% 5128     5.0KB/s   00:00    
ndb_1.pid                                                                                                                   100%    5     0.0KB/s   00:00    

 Copying configuration file...

        config.ini

Please attach ndb_error_report_20130502084316.tar.bz2 to your error report

I see you report this bug using 7.3.0 while I see you have used 7.3.1 in bug #69072. Please try to only use latest version while testing development releases.

/Gustaf
[2 May 2013 15:57] Ben Im
I did run ndb_error_reporter in /usr/local/mysql/bin directory to ensure that ndb_config is in the path. I still got the same error. When I ran ndb_config as separate program, then I got "3 4 5 6 7 8" which are my ndb data node numbers.
[3 May 2013 13:02] Gustaf Thorslund
Could you please send the output of:

shell> echo $PATH
shell> ls -l /usr/local/mysql/

/Gustaf
[4 Jun 2013 1:00] Bugs System
No feedback was provided for this bug for over a month, so it is
being suspended automatically. If you are able to provide the
information that was originally requested, please do so and change
the status of the bug back to "Open".