[ushastry@ushastry mysql-test]$ ./mysql-test-run.pl --debug 71343 Logging: ./mysql-test-run.pl --debug 71343 2014-01-10 23:49:28 15798 [Warning] Buffered warning: Changed limits: max_open_files: 1024 (requested 5000) 2014-01-10 23:49:28 15798 [Warning] Buffered warning: Changed limits: table_cache: 431 (requested 2000) 2014-01-10 23:49:28 15798 [Note] Plugin 'FEDERATED' is disabled. 2014-01-10 23:49:28 15798 [Note] Binlog end 2014-01-10 23:49:28 15798 [Note] Shutting down plugin 'CSV' 2014-01-10 23:49:28 15798 [Note] Shutting down plugin 'MyISAM' MySQL Version 5.6.15 Checking supported features... - SSL connections supported - binaries are debug compiled Collecting tests... Checking leftover processes... Removing old var directory... Creating var directory '/home/ushastry/mybuilds/mysql-5.6.15-release/mysql-test/var'... Installing system database... Using server port 35514 ============================================================================== TEST RESULT TIME (ms) or COMMENT -------------------------------------------------------------------------- worker[1] Using MTR_BUILD_THREAD 300, with reserved ports 13000..13009 CREATE TABLE innodb_lock_monitor (a INT) ENGINE=INNODB; CREATE TABLE t1 (a INT PRIMARY KEY) ENGINE=InnoDB; INSERT INTO t1 VALUES (0); BEGIN; SELECT * FROM t1 LOCK IN SHARE MODE; a 0 SET DEBUG_SYNC='innodb_monitor_before_lock_page_read SIGNAL monitor_ready WAIT_FOR finish'; SHOW ENGINE INNODB STATUS; SET DEBUG_SYNC='now WAIT_FOR monitor_ready'; COMMIT; DROP TABLE t1; SET DEBUG_SYNC='now SIGNAL finish'; main.71343 [ fail ] Test ended at 2014-01-10 23:49:45 CURRENT_TEST: main.71343 mysqltest: At line 33: query 'REAP' failed: 2013: Lost connection to MySQL server during query Server [mysqld.1 - pid: 15829, winpid: 15829, exit: 256] failed during test run Server log from this test: ----------SERVER LOG START----------- 2014-01-10 21:19:38 0 [Warning] TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit_defaults_for_timestamp server option (see documentation for more details). 2014-01-10 21:19:38 15830 [Warning] Buffered warning: Could not increase number of max_open_files to more than 1024 (request: 4161) 2014-01-10 21:19:38 15830 [Warning] Buffered warning: Changed limits: table_cache: 431 (requested 2000) 2014-01-10 21:19:38 15830 [Note] Plugin 'FEDERATED' is disabled. 2014-01-10 21:19:38 7f245f26c720 InnoDB: Warning: Using innodb_additional_mem_pool_size is DEPRECATED. This option may be removed in future releases, together with the option innodb_use_sys_malloc and with the InnoDB's internal memory allocator. 2014-01-10 21:19:38 7f245f26c720 InnoDB: !!!!!!!! UNIV_DEBUG switched on !!!!!!!!! 2014-01-10 21:19:38 7f245f26c720 InnoDB: !!!!!!!! UNIV_SYNC_DEBUG switched on !!!!!!!!! 2014-01-10 21:19:38 15830 [Note] InnoDB: The InnoDB memory heap is disabled 2014-01-10 21:19:38 15830 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2014-01-10 21:19:38 15830 [Note] InnoDB: Compressed tables use zlib 1.2.3 2014-01-10 21:19:38 15830 [Note] InnoDB: Using Linux native AIO 2014-01-10 21:19:38 15830 [Note] InnoDB: Not using CPU crc32 instructions 2014-01-10 21:19:38 15830 [Note] InnoDB: Initializing buffer pool, size = 8.0M 2014-01-10 21:19:38 15830 [Note] InnoDB: Completed initialization of buffer pool 2014-01-10 21:19:38 15830 [Note] InnoDB: Highest supported file format is Barracuda. 2014-01-10 21:19:39 15830 [Note] InnoDB: 128 rollback segment(s) are active. 2014-01-10 21:19:39 15830 [Note] InnoDB: Waiting for purge to start 2014-01-10 21:19:39 15830 [Note] InnoDB: 5.6.15 started; log sequence number 1625977 2014-01-10 21:19:39 15830 [Warning] No existing UUID has been found, so we assume that this is the first time that this server has been started. Generating a new UUID: c50f8094-7a23-11e3-9f4f-0800272e2cce. 2014-01-10 21:19:39 15830 [Note] Server hostname (bind-address): '*'; port: 13000 2014-01-10 21:19:39 15830 [Note] IPv6 is available. 2014-01-10 21:19:39 15830 [Note] - '::' resolves to '::'; 2014-01-10 21:19:39 15830 [Note] Server socket created on IP: '::'. 2014-01-10 21:19:40 15830 [Note] Event Scheduler: Loaded 0 events 2014-01-10 21:19:40 15830 [Note] /home/ushastry/mybuilds/mysql-5.6.15-release/sql/mysqld: ready for connections. Version: '5.6.15-debug-log' socket: '/home/ushastry/mybuilds/mysql-5.6.15-release/mysql-test/var/tmp/mysqld.1.sock' port: 13000 Source distribution 2014-01-10 21:19:41 7f245c0d5710 InnoDB: Assertion failure in thread 139794139928336 in file buf0buf.cc line 2461 InnoDB: Failing assertion: zip_size == fil_space_get_zip_size(space) InnoDB: We intentionally generate a memory trap. InnoDB: Submit a detailed bug report to http://bugs.mysql.com. InnoDB: If you get repeated assertion failures or crashes, even InnoDB: immediately after the mysqld startup, there may be InnoDB: corruption in the InnoDB tablespace. Please refer to InnoDB: http://dev.mysql.com/doc/refman/5.6/en/forcing-innodb-recovery.html InnoDB: about forcing recovery. 18:19:41 UTC - mysqld got signal 6 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. key_buffer_size=1048576 read_buffer_size=131072 max_used_connections=2 max_threads=151 thread_count=2 connection_count=2 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 61079 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x2e8a720 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 7f245c0d4de0 thread_stack 0x40000 /home/ushastry/mybuilds/mysql-5.6.15-release/sql/mysqld(my_print_stacktrace+0x35)[0xa690dc] /home/ushastry/mybuilds/mysql-5.6.15-release/sql/mysqld(handle_fatal_signal+0x3be)[0x708b3e] /lib64/libpthread.so.0[0x328280f4c0] /lib64/libc.so.6(gsignal+0x35)[0x3281c329a5] /lib64/libc.so.6(abort+0x175)[0x3281c34185] /home/ushastry/mybuilds/mysql-5.6.15-release/sql/mysqld[0xc9d15c] /home/ushastry/mybuilds/mysql-5.6.15-release/sql/mysqld[0xb3b7dd] /home/ushastry/mybuilds/mysql-5.6.15-release/sql/mysqld[0xc17cff] /home/ushastry/mybuilds/mysql-5.6.15-release/sql/mysqld[0xaf3693] /home/ushastry/mybuilds/mysql-5.6.15-release/sql/mysqld[0xaf3f93] /home/ushastry/mybuilds/mysql-5.6.15-release/sql/mysqld(_Z14ha_show_statusP3THDP10handlerton12ha_stat_type+0x28c)[0x62b83c] /home/ushastry/mybuilds/mysql-5.6.15-release/sql/mysqld(_Z21mysql_execute_commandP3THD+0x1300)[0x7b0858] /home/ushastry/mybuilds/mysql-5.6.15-release/sql/mysqld(_Z11mysql_parseP3THDPcjP12Parser_state+0x40a)[0x7b9bc1] /home/ushastry/mybuilds/mysql-5.6.15-release/sql/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcj+0xc4c)[0x7ad28d] /home/ushastry/mybuilds/mysql-5.6.15-release/sql/mysqld(_Z10do_commandP3THD+0x311)[0x7ac412] /home/ushastry/mybuilds/mysql-5.6.15-release/sql/mysqld(_Z24do_handle_one_connectionP3THD+0x19d)[0x776261] /home/ushastry/mybuilds/mysql-5.6.15-release/sql/mysqld(handle_one_connection+0x33)[0x775d8a] /home/ushastry/mybuilds/mysql-5.6.15-release/sql/mysqld(pfs_spawn_thread+0x156)[0xad02dd] /lib64/libpthread.so.0[0x32828077e1] /lib64/libc.so.6(clone+0x6d)[0x3281ce153d] Trying to get some variables. Some pointers may be invalid and cause the dump to abort. Query (2e96580): SHOW ENGINE INNODB STATUS Connection ID (thread ID): 3 Status: NOT_KILLED The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains information that should help you find out what is causing the crash. Writing a core file ----------SERVER LOG END------------- - saving '/home/ushastry/mybuilds/mysql-5.6.15-release/mysql-test/var/log/main.71343/' to '/home/ushastry/mybuilds/mysql-5.6.15-release/mysql-test/var/log/main.71343/' - found 'core.15830' (0/5) Trying 'dbx' to get a backtrace Trying 'gdb' to get a backtrace Core generated by '/home/ushastry/mybuilds/mysql-5.6.15-release/sql/mysqld' Output from gdb follows. The first stack trace is from the failing thread. The following stack traces are from all threads (so the failing one is duplicated). -------------------------- Missing separate debuginfo for Try: yum --disablerepo='*' --enablerepo='*-debug*' install /usr/lib/debug/.build-id/23/dcd11f478b82724ef49c9a495c81dff5bc8bf2 [New Thread 15856] [New Thread 15830] [New Thread 15832] [New Thread 15833] [New Thread 15834] [New Thread 15835] [New Thread 15836] [New Thread 15837] [New Thread 15839] [New Thread 15840] [New Thread 15841] [New Thread 15842] [New Thread 15844] [New Thread 15845] [New Thread 15846] [New Thread 15847] [New Thread 15848] [New Thread 15852] [New Thread 15843] [Thread debugging using libthread_db enabled] Core was generated by `/home/ushastry/mybuilds/mysql-5.6.15-release/sql/mysqld --defaults-group-suffix'. Program terminated with signal 6, Aborted. #0 0x000000328280c69c in pthread_kill () from /lib64/libpthread.so.0 #0 0x000000328280c69c in pthread_kill () from /lib64/libpthread.so.0 #1 0x0000000000a6915e in my_write_core (sig=6) at /home/ushastry/mybuilds/mysql-5.6.15-release/mysys/stacktrace.c:422 #2 0x0000000000708d26 in handle_fatal_signal (sig=6) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/signal_handler.cc:248 #3 #4 0x0000003281c329a5 in raise () from /lib64/libc.so.6 #5 0x0000003281c34185 in abort () from /lib64/libc.so.6 #6 0x0000000000c9d15c in buf_page_get_gen (space=7, zip_size=0, offset=3, rw_latch=3, guess=0x0, mode=14, file=0x106b0c0 "/home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/lock/lock0lock.cc", line=5383, mtr=0x7f245c0d2920) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/buf/buf0buf.cc:2461 #7 0x0000000000b3b7dd in lock_print_info_all_transactions (file=0x2be5910) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/lock/lock0lock.cc:5383 #8 0x0000000000c17cff in srv_printf_innodb_monitor (file=0x2be5910, nowait=0, trx_start_pos=0x7f245c0d2f60, trx_end=0x7f245c0d2f58) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/srv/srv0srv.cc:1191 #9 0x0000000000af3693 in innodb_show_status (hton=0x2bc2570, thd=0x2e8a720, stat_print=0x62b427 ) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/handler/ha_innodb.cc:12402 #10 0x0000000000af3f93 in innobase_show_status (hton=0x2bc2570, thd=0x2e8a720, stat_print=0x62b427 , stat_type=HA_ENGINE_STATUS) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/handler/ha_innodb.cc:12633 #11 0x000000000062b83c in ha_show_status (thd=0x2e8a720, db_type=0x2bc2570, stat=HA_ENGINE_STATUS) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/handler.cc:6928 #12 0x00000000007b0858 in mysql_execute_command (thd=0x2e8a720) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_parse.cc:2822 #13 0x00000000007b9bc1 in mysql_parse (thd=0x2e8a720, rawbuf=0x2e96580 "SHOW ENGINE INNODB STATUS", length=25, parser_state=0x7f245c0d4680) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_parse.cc:6235 #14 0x00000000007ad28d in dispatch_command (command=COM_QUERY, thd=0x2e8a720, packet=0x2e8e421 "", packet_length=25) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_parse.cc:1334 #15 0x00000000007ac412 in do_command (thd=0x2e8a720) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_parse.cc:1036 #16 0x0000000000776261 in do_handle_one_connection (thd_arg=0x2e8a720) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_connect.cc:982 #17 0x0000000000775d8a in handle_one_connection (arg=0x2e8a720) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_connect.cc:898 #18 0x0000000000ad02dd in pfs_spawn_thread (arg=0x2d05840) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/perfschema/pfs.cc:1858 #19 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #20 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 19 (Thread 0x7f245107a710 (LWP 15843)): #0 0x000000328280b43c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000000000b6075d in os_cond_wait (cond=0x2bc3f30, fast_mutex=0x2bc3ef0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0sync.cc:214 #2 0x0000000000b60cab in os_event_wait_low (event=0x2bc3ef0, reset_sig_count=2) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0sync.cc:610 #3 0x0000000000c1a4c3 in srv_purge_coordinator_suspend (slot=0x2bc3d00, rseg_history_len=3) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/srv/srv0srv.cc:2631 #4 0x0000000000c1a974 in srv_purge_coordinator_thread (arg=0x0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/srv/srv0srv.cc:2748 #5 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #6 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 18 (Thread 0x7f245c116710 (LWP 15852)): #0 0x0000003281cd7e33 in poll () from /lib64/libc.so.6 #1 0x0000000000e0fc98 in vio_io_wait (vio=0x2e86520, event=VIO_IO_EVENT_READ, timeout=28800000) at /home/ushastry/mybuilds/mysql-5.6.15-release/vio/viosocket.c:771 #2 0x0000000000e0ea98 in vio_socket_io_wait (vio=0x2e86520, event=VIO_IO_EVENT_READ) at /home/ushastry/mybuilds/mysql-5.6.15-release/vio/viosocket.c:68 #3 0x0000000000e0eb74 in vio_read (vio=0x2e86520, buf=0x2e86710 "\a", size=4) at /home/ushastry/mybuilds/mysql-5.6.15-release/vio/viosocket.c:123 #4 0x00000000006fb50f in net_read_raw_loop (net=0x2db6af0, count=4) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/net_serv.cc:669 #5 0x00000000006fb6da in net_read_packet_header (net=0x2db6af0) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/net_serv.cc:751 #6 0x00000000006fb7e5 in net_read_packet (net=0x2db6af0, complen=0x7f245c115ce8) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/net_serv.cc:816 #7 0x00000000006fb977 in my_net_read (net=0x2db6af0) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/net_serv.cc:894 #8 0x00000000007ac1d4 in do_command (thd=0x2db68e0) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_parse.cc:970 #9 0x0000000000776261 in do_handle_one_connection (thd_arg=0x2db68e0) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_connect.cc:982 #10 0x0000000000775d8a in handle_one_connection (arg=0x2db68e0) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_connect.cc:898 #11 0x0000000000ad02dd in pfs_spawn_thread (arg=0x2d04c50) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/perfschema/pfs.cc:1858 #12 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #13 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 17 (Thread 0x7f245c157710 (LWP 15848)): #0 0x000000328280f265 in sigwait () from /lib64/libpthread.so.0 #1 0x0000000000609832 in signal_hand (arg=0x0) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/mysqld.cc:3179 #2 0x0000000000ad02dd in pfs_spawn_thread (arg=0x2cfe080) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/perfschema/pfs.cc:1858 #3 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #4 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 16 (Thread 0x7f2442ffd710 (LWP 15847)): #0 0x000000328280b7a9 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000000000b60667 in os_cond_wait_timed (cond=0x2d03d90, fast_mutex=0x2d03d50, abstime=0x7f2442ffcda0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0sync.cc:177 #2 0x0000000000b60e88 in os_event_wait_time_low (event=0x2d03d50, time_in_usec=5000000, reset_sig_count=1) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0sync.cc:723 #3 0x0000000000c5a3bc in ib_wqueue_timedwait (wq=0x2d01848, wait_in_usecs=5000000) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/ut/ut0wqueue.cc:154 #4 0x0000000000d2cd68 in fts_optimize_thread (arg=0x2d01848) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/fts/fts0opt.cc:2994 #5 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #6 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 15 (Thread 0x7f24437fe710 (LWP 15846)): #0 0x000000328280b7a9 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000000000b60667 in os_cond_wait_timed (cond=0x2ce1d10, fast_mutex=0x2ce1cd0, abstime=0x7f24437fde50) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0sync.cc:177 #2 0x0000000000b60e88 in os_event_wait_time_low (event=0x2ce1cd0, time_in_usec=10000000, reset_sig_count=1) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0sync.cc:723 #3 0x0000000000cf2291 in dict_stats_thread (arg=0x0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/dict/dict0stats_bg.cc:349 #4 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #5 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 14 (Thread 0x7f2443fff710 (LWP 15845)): #0 0x000000328280b43c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000000000b6075d in os_cond_wait (cond=0x2bc40e0, fast_mutex=0x2bc40a0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0sync.cc:214 #2 0x0000000000b60cab in os_event_wait_low (event=0x2bc40a0, reset_sig_count=1) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0sync.cc:610 #3 0x0000000000ca965b in buf_dump_thread (arg=0x0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/buf/buf0dump.cc:594 #4 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #5 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 13 (Thread 0x7f2450879710 (LWP 15844)): #0 0x0000003281cda093 in select () from /lib64/libc.so.6 #1 0x0000000000b619c7 in os_thread_sleep (tm=1000000) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0thread.cc:258 #2 0x0000000000cb043f in page_cleaner_sleep_if_needed (next_loop_time=1389377981965) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/buf/buf0flu.cc:2379 #3 0x0000000000cb0527 in buf_flush_page_cleaner_thread (arg=0x0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/buf/buf0flu.cc:2420 #4 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #5 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 12 (Thread 0x7f245187b710 (LWP 15842)): #0 0x0000003281cda093 in select () from /lib64/libc.so.6 #1 0x0000000000b619c7 in os_thread_sleep (tm=1000000) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0thread.cc:258 #2 0x0000000000c19b63 in srv_master_sleep () at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/srv/srv0srv.cc:2294 #3 0x0000000000c19c76 in srv_master_thread (arg=0x0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/srv/srv0srv.cc:2338 #4 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #5 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 11 (Thread 0x7f245207c710 (LWP 15841)): #0 0x000000328280b7a9 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000000000b60667 in os_cond_wait_timed (cond=0x2bc4050, fast_mutex=0x2bc4010, abstime=0x7f245207bde0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0sync.cc:177 #2 0x0000000000b60e88 in os_event_wait_time_low (event=0x2bc4010, time_in_usec=5000000, reset_sig_count=1) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0sync.cc:723 #3 0x0000000000c187fd in srv_monitor_thread (arg=0x0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/srv/srv0srv.cc:1532 #4 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #5 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 10 (Thread 0x7f245287d710 (LWP 15840)): #0 0x000000328280b7a9 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000000000b60667 in os_cond_wait_timed (cond=0x2bc3fc0, fast_mutex=0x2bc3f80, abstime=0x7f245287cdf0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0sync.cc:177 #2 0x0000000000b60e88 in os_event_wait_time_low (event=0x2bc3f80, time_in_usec=1000000, reset_sig_count=1) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0sync.cc:723 #3 0x0000000000c18da5 in srv_error_monitor_thread (arg=0x0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/srv/srv0srv.cc:1763 #4 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #5 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 9 (Thread 0x7f245307e710 (LWP 15839)): #0 0x000000328280b7a9 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000000000b60667 in os_cond_wait_timed (cond=0x2cd8250, fast_mutex=0x2cd8210, abstime=0x7f245307de30) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0sync.cc:177 #2 0x0000000000b60e88 in os_event_wait_time_low (event=0x2cd8210, time_in_usec=1000000, reset_sig_count=2) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0sync.cc:723 #3 0x0000000000b41c68 in lock_wait_timeout_thread (arg=0x0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/lock/lock0wait.cc:503 #4 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #5 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 8 (Thread 0x7f2453ca8710 (LWP 15837)): #0 0x0000003281800614 in ?? () from /lib64/libaio.so.1 #1 0x0000000000b5e392 in os_aio_linux_collect (array=0x2c1b710, segment=1, seg_size=256) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0file.cc:4918 #2 0x0000000000b5e734 in os_aio_linux_handle (global_seg=5, message1=0x7f2453ca7e40, message2=0x7f2453ca7e38, type=0x7f2453ca7e30) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0file.cc:5062 #3 0x0000000000d02ec8 in fil_aio_wait (segment=5) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/fil/fil0fil.cc:5568 #4 0x0000000000c1d0e1 in io_handler_thread (arg=0x17cb8c8) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/srv/srv0start.cc:480 #5 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #6 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 7 (Thread 0x7f24544a9710 (LWP 15836)): #0 0x0000003281800614 in ?? () from /lib64/libaio.so.1 #1 0x0000000000b5e392 in os_aio_linux_collect (array=0x2c1b710, segment=0, seg_size=256) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0file.cc:4918 #2 0x0000000000b5e734 in os_aio_linux_handle (global_seg=4, message1=0x7f24544a8e40, message2=0x7f24544a8e38, type=0x7f24544a8e30) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0file.cc:5062 #3 0x0000000000d02ec8 in fil_aio_wait (segment=4) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/fil/fil0fil.cc:5568 #4 0x0000000000c1d0e1 in io_handler_thread (arg=0x17cb8c0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/srv/srv0start.cc:480 #5 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #6 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 6 (Thread 0x7f2454caa710 (LWP 15835)): #0 0x0000003281800614 in ?? () from /lib64/libaio.so.1 #1 0x0000000000b5e392 in os_aio_linux_collect (array=0x2bb8e70, segment=1, seg_size=256) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0file.cc:4918 #2 0x0000000000b5e734 in os_aio_linux_handle (global_seg=3, message1=0x7f2454ca9e40, message2=0x7f2454ca9e38, type=0x7f2454ca9e30) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0file.cc:5062 #3 0x0000000000d02ec8 in fil_aio_wait (segment=3) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/fil/fil0fil.cc:5568 #4 0x0000000000c1d0e1 in io_handler_thread (arg=0x17cb8b8) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/srv/srv0start.cc:480 #5 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #6 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 5 (Thread 0x7f24554ab710 (LWP 15834)): #0 0x0000003281800614 in ?? () from /lib64/libaio.so.1 #1 0x0000000000b5e392 in os_aio_linux_collect (array=0x2bb8e70, segment=0, seg_size=256) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0file.cc:4918 #2 0x0000000000b5e734 in os_aio_linux_handle (global_seg=2, message1=0x7f24554aae40, message2=0x7f24554aae38, type=0x7f24554aae30) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0file.cc:5062 #3 0x0000000000d02ec8 in fil_aio_wait (segment=2) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/fil/fil0fil.cc:5568 #4 0x0000000000c1d0e1 in io_handler_thread (arg=0x17cb8b0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/srv/srv0start.cc:480 #5 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #6 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 4 (Thread 0x7f2455cac710 (LWP 15833)): #0 0x0000003281800614 in ?? () from /lib64/libaio.so.1 #1 0x0000000000b5e392 in os_aio_linux_collect (array=0x2c01190, segment=0, seg_size=256) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0file.cc:4918 #2 0x0000000000b5e734 in os_aio_linux_handle (global_seg=1, message1=0x7f2455cabe40, message2=0x7f2455cabe38, type=0x7f2455cabe30) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0file.cc:5062 #3 0x0000000000d02ec8 in fil_aio_wait (segment=1) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/fil/fil0fil.cc:5568 #4 0x0000000000c1d0e1 in io_handler_thread (arg=0x17cb8a8) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/srv/srv0start.cc:480 #5 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #6 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 3 (Thread 0x7f245f26a710 (LWP 15832)): #0 0x0000003281800614 in ?? () from /lib64/libaio.so.1 #1 0x0000000000b5e392 in os_aio_linux_collect (array=0x2c0e450, segment=0, seg_size=256) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0file.cc:4918 #2 0x0000000000b5e734 in os_aio_linux_handle (global_seg=0, message1=0x7f245f269e40, message2=0x7f245f269e38, type=0x7f245f269e30) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0file.cc:5062 #3 0x0000000000d02ec8 in fil_aio_wait (segment=0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/fil/fil0fil.cc:5568 #4 0x0000000000c1d0e1 in io_handler_thread (arg=0x17cb8a0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/srv/srv0start.cc:480 #5 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #6 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 2 (Thread 0x7f245f26c720 (LWP 15830)): #0 0x0000003281cd7e33 in poll () from /lib64/libc.so.6 #1 0x000000000060e123 in handle_connections_sockets () at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/mysqld.cc:6232 #2 0x000000000060d4e2 in mysqld_main (argc=78, argv=0x2ab8778) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/mysqld.cc:5651 #3 0x00000000006033a4 in main (argc=8, argv=0x7fff806d6b38) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/main.cc:25 Thread 1 (Thread 0x7f245c0d5710 (LWP 15856)): #0 0x000000328280c69c in pthread_kill () from /lib64/libpthread.so.0 #1 0x0000000000a6915e in my_write_core (sig=6) at /home/ushastry/mybuilds/mysql-5.6.15-release/mysys/stacktrace.c:422 #2 0x0000000000708d26 in handle_fatal_signal (sig=6) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/signal_handler.cc:248 #3 #4 0x0000003281c329a5 in raise () from /lib64/libc.so.6 #5 0x0000003281c34185 in abort () from /lib64/libc.so.6 #6 0x0000000000c9d15c in buf_page_get_gen (space=7, zip_size=0, offset=3, rw_latch=3, guess=0x0, mode=14, file=0x106b0c0 "/home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/lock/lock0lock.cc", line=5383, mtr=0x7f245c0d2920) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/buf/buf0buf.cc:2461 #7 0x0000000000b3b7dd in lock_print_info_all_transactions (file=0x2be5910) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/lock/lock0lock.cc:5383 #8 0x0000000000c17cff in srv_printf_innodb_monitor (file=0x2be5910, nowait=0, trx_start_pos=0x7f245c0d2f60, trx_end=0x7f245c0d2f58) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/srv/srv0srv.cc:1191 #9 0x0000000000af3693 in innodb_show_status (hton=0x2bc2570, thd=0x2e8a720, stat_print=0x62b427 ) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/handler/ha_innodb.cc:12402 #10 0x0000000000af3f93 in innobase_show_status (hton=0x2bc2570, thd=0x2e8a720, stat_print=0x62b427 , stat_type=HA_ENGINE_STATUS) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/handler/ha_innodb.cc:12633 #11 0x000000000062b83c in ha_show_status (thd=0x2e8a720, db_type=0x2bc2570, stat=HA_ENGINE_STATUS) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/handler.cc:6928 #12 0x00000000007b0858 in mysql_execute_command (thd=0x2e8a720) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_parse.cc:2822 #13 0x00000000007b9bc1 in mysql_parse (thd=0x2e8a720, rawbuf=0x2e96580 "SHOW ENGINE INNODB STATUS", length=25, parser_state=0x7f245c0d4680) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_parse.cc:6235 #14 0x00000000007ad28d in dispatch_command (command=COM_QUERY, thd=0x2e8a720, packet=0x2e8e421 "", packet_length=25) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_parse.cc:1334 #15 0x00000000007ac412 in do_command (thd=0x2e8a720) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_parse.cc:1036 #16 0x0000000000776261 in do_handle_one_connection (thd_arg=0x2e8a720) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_connect.cc:982 #17 0x0000000000775d8a in handle_one_connection (arg=0x2e8a720) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_connect.cc:898 #18 0x0000000000ad02dd in pfs_spawn_thread (arg=0x2d05840) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/perfschema/pfs.cc:1858 #19 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #20 0x0000003281ce153d in clone () from /lib64/libc.so.6 -------------------------------------------------------------------------- The servers were restarted 0 times Spent 0.000 of 22 seconds executing testcases Completed: Failed 1/1 tests, 0.00% were successful. Failing test(s): main.71343 The log files in var/log may give you some hint of what went wrong. If you want to report this error, please read first the documentation at http://dev.mysql.com/doc/mysql/en/mysql-test-suite.html mysql-test-run: *** ERROR: there were failing test cases