// [umshastr@hod03]/export/umesh/server/source: md5sum mysql-5.6.26.tar.gz 733e1817c88c16fb193176e76f5b818f mysql-5.6.26.tar.gz [umshastr@hod03]/export/umesh/server/source/mysql-5.6.26: cat docs/INFO_SRC commit: 1f0fdfb6cce6027214de394484c3ab16841bb7cc date: 2015-06-25 15:06:45 +0200 build-date: 2015-07-14 23:27:56 +0200 short: 1f0fdfb branch: mysql-5.6.26-release MySQL source 5.6.26 -- cmake . -DCMAKE_BUILD_TYPE=Debug -DCMAKE_INSTALL_PREFIX=/export/umesh/server/source/mysql-5.6.26 make -j16 make install [umshastr@hod03]/export/umesh/server/source/mysql-5.6.26/mysql-test: vi t/77976.test [umshastr@hod03]/export/umesh/server/source/mysql-5.6.26/mysql-test: [umshastr@hod03]/export/umesh/server/source/mysql-5.6.26/mysql-test: cat t/77976.test DROP DATABASE test; CREATE DATABASE test; USE test; SET GLOBAL innodb_buffer_pool_load_now=ON; [umshastr@hod03]/export/umesh/server/source/mysql-5.6.26/mysql-test: ./mtr --mysqld='--innodb-force-recovery=6' 77976 Logging: ./mtr --mysqld=--innodb-force-recovery=6 77976 2015-08-07 11:51:52 0 [Note] /export/umesh/server/source/mysql-5.6.26/sql/mysqld (mysqld 5.6.26-debug) starting as process 18565 ... 2015-08-07 11:51:52 18565 [Note] Plugin 'FEDERATED' is disabled. 2015-08-07 11:51:52 18565 [Note] Binlog end 2015-08-07 11:51:52 18565 [Note] Shutting down plugin 'CSV' 2015-08-07 11:51:52 18565 [Note] Shutting down plugin 'MyISAM' MySQL Version 5.6.26 Checking supported features... - SSL connections supported - binaries are debug compiled Collecting tests... Checking leftover processes... Removing old var directory... Creating var directory '/export/umesh/server/source/mysql-5.6.26/mysql-test/var'... Installing system database... ============================================================================== TEST RESULT TIME (ms) or COMMENT -------------------------------------------------------------------------- worker[1] Using MTR_BUILD_THREAD 300, with reserved ports 13000..13009 DROP DATABASE test; CREATE DATABASE test; USE test; main.77976 [ fail ] Test ended at 2015-08-07 11:51:56 CURRENT_TEST: main.77976 mysqltest: At line 4: query 'SET GLOBAL innodb_buffer_pool_load_now=ON' failed: 2013: Lost connection to MySQL server during query Server [mysqld.1 - pid: 18590, winpid: 18590, exit: 256] failed during test run Server log from this test: ----------SERVER LOG START----------- 2015-08-07 12:51:55 0 [Warning] TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit_defaults_for_timestamp server option (see documentation for more details). 2015-08-07 12:51:55 0 [Note] /export/umesh/server/source/mysql-5.6.26/sql/mysqld (mysqld 5.6.26-debug-log) starting as process 18591 ... 2015-08-07 12:51:55 18591 [Note] Plugin 'FEDERATED' is disabled. 2015-08-07 12:51:55 7f5c66b79740 InnoDB: Warning: Using innodb_additional_mem_pool_size is DEPRECATED. This option may be removed in future releases, together with the option innodb_use_sys_malloc and with the InnoDB's internal memory allocator. 2015-08-07 12:51:55 18591 [Note] InnoDB: Started in read only mode 2015-08-07 12:51:55 18591 [Note] InnoDB: Using atomics to ref count buffer pool pages 2015-08-07 12:51:55 7f5c66b79740 InnoDB: !!!!!!!! UNIV_DEBUG switched on !!!!!!!!! 2015-08-07 12:51:55 7f5c66b79740 InnoDB: !!!!!!!! UNIV_SYNC_DEBUG switched on !!!!!!!!! 2015-08-07 12:51:55 18591 [Note] InnoDB: The InnoDB memory heap is disabled 2015-08-07 12:51:55 18591 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2015-08-07 12:51:55 18591 [Note] InnoDB: Memory barrier is not used 2015-08-07 12:51:55 18591 [Note] InnoDB: Compressed tables use zlib 1.2.3 2015-08-07 12:51:55 18591 [Note] InnoDB: Using Linux native AIO 2015-08-07 12:51:55 18591 [Note] InnoDB: Using CPU crc32 instructions 2015-08-07 12:51:55 18591 [Note] InnoDB: Disabling background IO write threads. 2015-08-07 12:51:55 18591 [Note] InnoDB: Initializing buffer pool, size = 8.0M 2015-08-07 12:51:55 18591 [Note] InnoDB: Completed initialization of buffer pool 2015-08-07 12:51:55 18591 [Note] InnoDB: Highest supported file format is Barracuda. 2015-08-07 12:51:55 18591 [Note] InnoDB: The user has set SRV_FORCE_NO_LOG_REDO on, skipping log redo 2015-08-07 12:51:56 18591 [Note] InnoDB: 5.6.26 started; log sequence number 0 2015-08-07 12:51:56 18591 [Note] InnoDB: !!! innodb_force_recovery is set to 6 !!! 2015-08-07 12:51:56 18591 [Warning] No existing UUID has been found, so we assume that this is the first time that this server has been started. Generating a new UUID: f08c2986-3ce9-11e5-9abc-0010e05f3e06. 2015-08-07 12:51:56 18591 [Note] Server hostname (bind-address): '*'; port: 13000 2015-08-07 12:51:56 18591 [Note] IPv6 is available. 2015-08-07 12:51:56 18591 [Note] - '::' resolves to '::'; 2015-08-07 12:51:56 18591 [Note] Server socket created on IP: '::'. 2015-08-07 12:51:56 18591 [ERROR] InnoDB: Failed to find tablespace for table '"mysql"."slave_master_info"' in the cache. Attempting to load the tablespace with space id 4. 2015-08-07 12:51:56 18591 [Warning] InnoDB: Allocated tablespace 4, old maximum was 0 2015-08-07 12:51:56 18591 [ERROR] InnoDB: Failed to find tablespace for table '"mysql"."slave_worker_info"' in the cache. Attempting to load the tablespace with space id 5. 2015-08-07 12:51:56 18591 [ERROR] InnoDB: Failed to find tablespace for table '"mysql"."slave_relay_log_info"' in the cache. Attempting to load the tablespace with space id 3. 2015-08-07 12:51:56 18591 [Note] Event Scheduler: Loaded 0 events 2015-08-07 12:51:56 18591 [Note] /export/umesh/server/source/mysql-5.6.26/sql/mysqld: ready for connections. Version: '5.6.26-debug-log' socket: '/export/umesh/server/source/mysql-5.6.26/mysql-test/var/tmp/mysqld.1.sock' port: 13000 Source distribution 2015-08-07 12:51:56 7f5c5f3b6700 InnoDB: Assertion failure in thread 140034711447296 in file os0sync.cc line 419 InnoDB: Failing assertion: event InnoDB: We intentionally generate a memory trap. InnoDB: Submit a detailed bug report to http://bugs.mysql.com. InnoDB: If you get repeated assertion failures or crashes, even InnoDB: immediately after the mysqld startup, there may be InnoDB: corruption in the InnoDB tablespace. Please refer to InnoDB: http://dev.mysql.com/doc/refman/5.6/en/forcing-innodb-recovery.html InnoDB: about forcing recovery. 09:51:56 UTC - mysqld got signal 6 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. key_buffer_size=1048576 read_buffer_size=131072 max_used_connections=1 max_threads=151 thread_count=1 connection_count=1 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 60945 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x2eb6fa0 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 7f5c5f3b5e60 thread_stack 0x40000 /export/umesh/server/source/mysql-5.6.26/sql/mysqld(my_print_stacktrace+0x35)[0xa73ef0] /export/umesh/server/source/mysql-5.6.26/sql/mysqld(handle_fatal_signal+0x39f)[0x71906b] /lib64/libpthread.so.0(+0xf130)[0x7f5c66773130] /lib64/libc.so.6(gsignal+0x39)[0x7f5c6557e5c9] /lib64/libc.so.6(abort+0x148)[0x7f5c6557fcd8] /export/umesh/server/source/mysql-5.6.26/sql/mysqld[0xb1c102] /export/umesh/server/source/mysql-5.6.26/sql/mysqld[0xc66b05] /export/umesh/server/source/mysql-5.6.26/sql/mysqld[0xab0656] /export/umesh/server/source/mysql-5.6.26/sql/mysqld(_ZN17sys_var_pluginvar13global_updateEP3THDP7set_var+0x34e)[0x7d7140] /export/umesh/server/source/mysql-5.6.26/sql/mysqld(_ZN7sys_var6updateEP3THDP7set_var+0x93)[0x716e93] /export/umesh/server/source/mysql-5.6.26/sql/mysqld(_ZN7set_var6updateEP3THD+0x38)[0x717f5c] /export/umesh/server/source/mysql-5.6.26/sql/mysqld(_Z17sql_set_variablesP3THDP4ListI12set_var_baseE+0xe8)[0x717b2b] /export/umesh/server/source/mysql-5.6.26/sql/mysqld(_Z21mysql_execute_commandP3THD+0x3a38)[0x7c3244] /export/umesh/server/source/mysql-5.6.26/sql/mysqld(_Z11mysql_parseP3THDPcjP12Parser_state+0x489)[0x7c9ffb] /export/umesh/server/source/mysql-5.6.26/sql/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcj+0xd1c)[0x7bd4c7] /export/umesh/server/source/mysql-5.6.26/sql/mysqld(_Z10do_commandP3THD+0x31e)[0x7bc542] /export/umesh/server/source/mysql-5.6.26/sql/mysqld(_Z24do_handle_one_connectionP3THD+0x195)[0x786257] /export/umesh/server/source/mysql-5.6.26/sql/mysqld(handle_one_connection+0x33)[0x785d57] /export/umesh/server/source/mysql-5.6.26/sql/mysqld(pfs_spawn_thread+0x156)[0xd54020] /lib64/libpthread.so.0(+0x7df3)[0x7f5c6676bdf3] /lib64/libc.so.6(clone+0x6d)[0x7f5c6563f47d] Trying to get some variables. Some pointers may be invalid and cause the dump to abort. Query (7f5c50004fd0): SET GLOBAL innodb_buffer_pool_load_now=ON Connection ID (thread ID): 2 Status: NOT_KILLED The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains information that should help you find out what is causing the crash. Writing a core file ----------SERVER LOG END------------- - saving '/export/umesh/server/source/mysql-5.6.26/mysql-test/var/log/main.77976/' to '/export/umesh/server/source/mysql-5.6.26/mysql-test/var/log/main.77976/' - found 'core.18591' (0/5) Trying 'dbx' to get a backtrace Trying 'gdb' to get a backtrace Core generated by '/export/umesh/server/source/mysql-5.6.26/sql/mysqld' Output from gdb follows. The first stack trace is from the failing thread. The following stack traces are from all threads (so the failing one is duplicated). -------------------------- [New LWP 18597] [New LWP 18592] [New LWP 18591] [New LWP 18594] [New LWP 18593] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `/export/umesh/server/source/mysql-5.6.26/sql/mysqld --defaults-group-suffix=.1'. Program terminated with signal 6, Aborted. #0 0x00007f5c66770771 in pthread_kill () from /lib64/libpthread.so.0 #0 0x00007f5c66770771 in pthread_kill () from /lib64/libpthread.so.0 #1 0x0000000000a73f72 in my_write_core (sig=6) at /export/umesh/server/source/mysql-5.6.26/mysys/stacktrace.c:422 #2 0x000000000071921b in handle_fatal_signal (sig=6) at /export/umesh/server/source/mysql-5.6.26/sql/signal_handler.cc:230 #3 #4 0x00007f5c6557e5c9 in raise () from /lib64/libc.so.6 #5 0x00007f5c6557fcd8 in abort () from /lib64/libc.so.6 #6 0x0000000000b1c102 in os_event_set (event=0x0) at /export/umesh/server/source/mysql-5.6.26/storage/innobase/os/os0sync.cc:419 #7 0x0000000000c66b05 in buf_load_start () at /export/umesh/server/source/mysql-5.6.26/storage/innobase/buf/buf0dump.cc:96 #8 0x0000000000ab0656 in buffer_pool_load_now (thd=0x2eb6fa0, var=0x14ee140 , var_ptr=0x17eca51 , save=0x7f5c50005188) at /export/umesh/server/source/mysql-5.6.26/storage/innobase/handler/ha_innodb.cc:15604 #9 0x00000000007d7140 in sys_var_pluginvar::global_update (this=0x2d0b480, thd=0x2eb6fa0, var=0x7f5c50005168) at /export/umesh/server/source/mysql-5.6.26/sql/sql_plugin.cc:3267 #10 0x0000000000716e93 in sys_var::update (this=0x2d0b480, thd=0x2eb6fa0, var=0x7f5c50005168) at /export/umesh/server/source/mysql-5.6.26/sql/set_var.cc:193 #11 0x0000000000717f5c in set_var::update (this=0x7f5c50005168, thd=0x2eb6fa0) at /export/umesh/server/source/mysql-5.6.26/sql/set_var.cc:670 #12 0x0000000000717b2b in sql_set_variables (thd=0x2eb6fa0, var_list=0x2eb9a08) at /export/umesh/server/source/mysql-5.6.26/sql/set_var.cc:573 #13 0x00000000007c3244 in mysql_execute_command (thd=0x2eb6fa0) at /export/umesh/server/source/mysql-5.6.26/sql/sql_parse.cc:3720 #14 0x00000000007c9ffb in mysql_parse (thd=0x2eb6fa0, rawbuf=0x7f5c50004fd0 "SET GLOBAL innodb_buffer_pool_load_now=ON", length=41, parser_state=0x7f5c5f3b5010) at /export/umesh/server/source/mysql-5.6.26/sql/sql_parse.cc:6386 #15 0x00000000007bd4c7 in dispatch_command (command=COM_QUERY, thd=0x2eb6fa0, packet=0x2f89ba1 "SET GLOBAL innodb_buffer_pool_load_now=ON", packet_length=41) at /export/umesh/server/source/mysql-5.6.26/sql/sql_parse.cc:1340 #16 0x00000000007bc542 in do_command (thd=0x2eb6fa0) at /export/umesh/server/source/mysql-5.6.26/sql/sql_parse.cc:1037 #17 0x0000000000786257 in do_handle_one_connection (thd_arg=0x2eb6fa0) at /export/umesh/server/source/mysql-5.6.26/sql/sql_connect.cc:982 #18 0x0000000000785d57 in handle_one_connection (arg=0x2eb6fa0) at /export/umesh/server/source/mysql-5.6.26/sql/sql_connect.cc:898 #19 0x0000000000d54020 in pfs_spawn_thread (arg=0x2f02ac0) at /export/umesh/server/source/mysql-5.6.26/storage/perfschema/pfs.cc:1860 #20 0x00007f5c6676bdf3 in start_thread () from /lib64/libpthread.so.0 #21 0x00007f5c6563f47d in clone () from /lib64/libc.so.6 Thread 5 (Thread 0x7f5c5fdf8700 (LWP 18593)): #0 0x00007f5c66562644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x0000000000b19aac in os_aio_linux_collect (array=0x2d15a80, segment=1, seg_size=256) at /export/umesh/server/source/mysql-5.6.26/storage/innobase/os/os0file.cc:4975 #2 0x0000000000b19e5a in os_aio_linux_handle (global_seg=1, message1=0x7f5c5fdf7ed0, message2=0x7f5c5fdf7ec8, type=0x7f5c5fdf7ec0) at /export/umesh/server/source/mysql-5.6.26/storage/innobase/os/os0file.cc:5119 #3 0x0000000000cc5b37 in fil_aio_wait (segment=1) at /export/umesh/server/source/mysql-5.6.26/storage/innobase/fil/fil0fil.cc:5754 #4 0x0000000000bdaffd in io_handler_thread (arg=0x17f95a8 ) at /export/umesh/server/source/mysql-5.6.26/storage/innobase/srv/srv0start.cc:489 #5 0x00007f5c6676bdf3 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f5c6563f47d in clone () from /lib64/libc.so.6 Thread 4 (Thread 0x7f5c5f3f7700 (LWP 18594)): #0 0x00007f5c66772ed1 in sigwait () from /lib64/libpthread.so.0 #1 0x000000000061a31f in signal_hand (arg=0x0) at /export/umesh/server/source/mysql-5.6.26/sql/mysqld.cc:3190 #2 0x0000000000d54020 in pfs_spawn_thread (arg=0x2d05480) at /export/umesh/server/source/mysql-5.6.26/storage/perfschema/pfs.cc:1860 #3 0x00007f5c6676bdf3 in start_thread () from /lib64/libpthread.so.0 #4 0x00007f5c6563f47d in clone () from /lib64/libc.so.6 Thread 3 (Thread 0x7f5c66b79740 (LWP 18591)): #0 0x00007f5c65634edd in poll () from /lib64/libc.so.6 #1 0x000000000061ebce in handle_connections_sockets () at /export/umesh/server/source/mysql-5.6.26/sql/mysqld.cc:6253 #2 0x000000000061dfac in mysqld_main (argc=80, argv=0x2bf8678) at /export/umesh/server/source/mysql-5.6.26/sql/mysqld.cc:5672 #3 0x0000000000614120 in main (argc=10, argv=0x7fff94b3b9c8) at /export/umesh/server/source/mysql-5.6.26/sql/main.cc:25 Thread 2 (Thread 0x7f5c607f9700 (LWP 18592)): #0 0x00007f5c66562644 in __io_getevents_0_4 () from /lib64/libaio.so.1 #1 0x0000000000b19aac in os_aio_linux_collect (array=0x2d15a80, segment=0, seg_size=256) at /export/umesh/server/source/mysql-5.6.26/storage/innobase/os/os0file.cc:4975 #2 0x0000000000b19e5a in os_aio_linux_handle (global_seg=0, message1=0x7f5c607f8ed0, message2=0x7f5c607f8ec8, type=0x7f5c607f8ec0) at /export/umesh/server/source/mysql-5.6.26/storage/innobase/os/os0file.cc:5119 #3 0x0000000000cc5b37 in fil_aio_wait (segment=0) at /export/umesh/server/source/mysql-5.6.26/storage/innobase/fil/fil0fil.cc:5754 #4 0x0000000000bdaffd in io_handler_thread (arg=0x17f95a0 ) at /export/umesh/server/source/mysql-5.6.26/storage/innobase/srv/srv0start.cc:489 #5 0x00007f5c6676bdf3 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f5c6563f47d in clone () from /lib64/libc.so.6 Thread 1 (Thread 0x7f5c5f3b6700 (LWP 18597)): #0 0x00007f5c66770771 in pthread_kill () from /lib64/libpthread.so.0 #1 0x0000000000a73f72 in my_write_core (sig=6) at /export/umesh/server/source/mysql-5.6.26/mysys/stacktrace.c:422 #2 0x000000000071921b in handle_fatal_signal (sig=6) at /export/umesh/server/source/mysql-5.6.26/sql/signal_handler.cc:230 #3 #4 0x00007f5c6557e5c9 in raise () from /lib64/libc.so.6 #5 0x00007f5c6557fcd8 in abort () from /lib64/libc.so.6 #6 0x0000000000b1c102 in os_event_set (event=0x0) at /export/umesh/server/source/mysql-5.6.26/storage/innobase/os/os0sync.cc:419 #7 0x0000000000c66b05 in buf_load_start () at /export/umesh/server/source/mysql-5.6.26/storage/innobase/buf/buf0dump.cc:96 #8 0x0000000000ab0656 in buffer_pool_load_now (thd=0x2eb6fa0, var=0x14ee140 , var_ptr=0x17eca51 , save=0x7f5c50005188) at /export/umesh/server/source/mysql-5.6.26/storage/innobase/handler/ha_innodb.cc:15604 #9 0x00000000007d7140 in sys_var_pluginvar::global_update (this=0x2d0b480, thd=0x2eb6fa0, var=0x7f5c50005168) at /export/umesh/server/source/mysql-5.6.26/sql/sql_plugin.cc:3267 #10 0x0000000000716e93 in sys_var::update (this=0x2d0b480, thd=0x2eb6fa0, var=0x7f5c50005168) at /export/umesh/server/source/mysql-5.6.26/sql/set_var.cc:193 #11 0x0000000000717f5c in set_var::update (this=0x7f5c50005168, thd=0x2eb6fa0) at /export/umesh/server/source/mysql-5.6.26/sql/set_var.cc:670 #12 0x0000000000717b2b in sql_set_variables (thd=0x2eb6fa0, var_list=0x2eb9a08) at /export/umesh/server/source/mysql-5.6.26/sql/set_var.cc:573 #13 0x00000000007c3244 in mysql_execute_command (thd=0x2eb6fa0) at /export/umesh/server/source/mysql-5.6.26/sql/sql_parse.cc:3720 #14 0x00000000007c9ffb in mysql_parse (thd=0x2eb6fa0, rawbuf=0x7f5c50004fd0 "SET GLOBAL innodb_buffer_pool_load_now=ON", length=41, parser_state=0x7f5c5f3b5010) at /export/umesh/server/source/mysql-5.6.26/sql/sql_parse.cc:6386 #15 0x00000000007bd4c7 in dispatch_command (command=COM_QUERY, thd=0x2eb6fa0, packet=0x2f89ba1 "SET GLOBAL innodb_buffer_pool_load_now=ON", packet_length=41) at /export/umesh/server/source/mysql-5.6.26/sql/sql_parse.cc:1340 #16 0x00000000007bc542 in do_command (thd=0x2eb6fa0) at /export/umesh/server/source/mysql-5.6.26/sql/sql_parse.cc:1037 #17 0x0000000000786257 in do_handle_one_connection (thd_arg=0x2eb6fa0) at /export/umesh/server/source/mysql-5.6.26/sql/sql_connect.cc:982 #18 0x0000000000785d57 in handle_one_connection (arg=0x2eb6fa0) at /export/umesh/server/source/mysql-5.6.26/sql/sql_connect.cc:898 #19 0x0000000000d54020 in pfs_spawn_thread (arg=0x2f02ac0) at /export/umesh/server/source/mysql-5.6.26/storage/perfschema/pfs.cc:1860 #20 0x00007f5c6676bdf3 in start_thread () from /lib64/libpthread.so.0 #21 0x00007f5c6563f47d in clone () from /lib64/libc.so.6 -------------------------------------------------------------------------- The servers were restarted 0 times Spent 0.000 of 6 seconds executing testcases Completed: Failed 1/1 tests, 0.00% were successful. Failing test(s): main.77976 The log files in var/log may give you some hint of what went wrong. If you want to report this error, please read first the documentation at http://dev.mysql.com/doc/mysql/en/mysql-test-suite.html mysql-test-run: *** ERROR: there were failing test cases [umshastr@hod03]/export/umesh/server/source/mysql-5.6.26/mysql-test: If you want to report this error, please read first the documentation at http://dev.mysql.com/doc/mysql/en/mysql-test-suite.html mysql-test-run: *** ERROR: there were failing test cases [umshastr@hod03]/export/umesh/server/source/mysql-5.6.26/mysql-test: