[ushastry@ushastry mysql-test]$ ./mysql-test-run.pl 71236 Logging: ./mysql-test-run.pl 71236 2013-12-27 16:16:38 2673 [Warning] Buffered warning: Changed limits: max_open_files: 1024 (requested 5000) 2013-12-27 16:16:38 2673 [Warning] Buffered warning: Changed limits: table_cache: 431 (requested 2000) 2013-12-27 16:16:38 2673 [Note] Plugin 'FEDERATED' is disabled. 2013-12-27 16:16:38 2673 [Note] Binlog end 2013-12-27 16:16:38 2673 [Note] Shutting down plugin 'CSV' 2013-12-27 16:16:38 2673 [Note] Shutting down plugin 'MyISAM' MySQL Version 5.6.15 Checking supported features... - SSL connections supported - binaries are debug compiled Collecting tests... Checking leftover processes... Removing old var directory... Creating var directory '/home/ushastry/mybuilds/mysql-5.6.15-release/mysql-test/var'... Installing system database... Using server port 58929 ============================================================================== TEST RESULT TIME (ms) or COMMENT -------------------------------------------------------------------------- worker[1] Using MTR_BUILD_THREAD 300, with reserved ports 13000..13009 CREATE PROCEDURE p_install(x INT) BEGIN DECLARE CONTINUE HANDLER FOR 1126 BEGIN END; WHILE x DO SET x= x - 1; INSTALL PLUGIN no_such_plugin SONAME 'no_such_object'; END WHILE; END| CREATE PROCEDURE p_show_vars(x INT) WHILE x DO SET x= x - 1; SHOW VARIABLES; END WHILE| CALL p_install(100);; CALL p_show_vars(100);; worker[1] Trying to dump core for [mysqltest - pid: 2724, winpid: 2724] worker[1] Trying to dump core for [mysqld.1 - pid: 2700, winpid: 2700] main.71236 [ fail ] timeout after 900 seconds Test ended at 2013-12-27 16:32:42 Test case timeout after 900 seconds == /home/ushastry/mybuilds/mysql-5.6.15-release/mysql-test/var/tmp/analyze-timeout-mysqld.1.err == mysqltest: Could not open connection 'default' after 500 attempts: 2002 Can't connect to local MySQL server through socket '/home/ushastry/mybuilds/mysql-5.6.15-release/mysql-test/var/tmp/mysqld.1.sock' (111) - saving '/home/ushastry/mybuilds/mysql-5.6.15-release/mysql-test/var/log/main.71236/' to '/home/ushastry/mybuilds/mysql-5.6.15-release/mysql-test/var/log/main.71236/' - found 'core.2701' (0/5) Trying 'dbx' to get a backtrace Trying 'gdb' to get a backtrace Core generated by '/home/ushastry/mybuilds/mysql-5.6.15-release/sql/mysqld' Output from gdb follows. The first stack trace is from the failing thread. The following stack traces are from all threads (so the failing one is duplicated). -------------------------- Missing separate debuginfo for Try: yum --disablerepo='*' --enablerepo='*-debug*' install /usr/lib/debug/.build-id/23/dcd11f478b82724ef49c9a495c81dff5bc8bf2 [New Thread 2701] [New Thread 2703] [New Thread 2704] [New Thread 2705] [New Thread 2706] [New Thread 2707] [New Thread 2708] [New Thread 2710] [New Thread 2711] [New Thread 2712] [New Thread 2713] [New Thread 2714] [New Thread 2715] [New Thread 2716] [New Thread 2717] [New Thread 2718] [New Thread 2719] [New Thread 2723] [New Thread 2727] [New Thread 2728] [Thread debugging using libthread_db enabled] Core was generated by `/home/ushastry/mybuilds/mysql-5.6.15-release/sql/mysqld --defaults-group-suffix'. Program terminated with signal 6, Aborted. #0 0x000000328280c69c in pthread_kill () from /lib64/libpthread.so.0 #0 0x000000328280c69c in pthread_kill () from /lib64/libpthread.so.0 #1 0x0000000000a6915e in my_write_core (sig=6) at /home/ushastry/mybuilds/mysql-5.6.15-release/mysys/stacktrace.c:422 #2 0x0000000000708d26 in handle_fatal_signal (sig=6) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/signal_handler.cc:248 #3 #4 0x0000003281cd7e33 in poll () from /lib64/libc.so.6 #5 0x000000000060e123 in handle_connections_sockets () at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/mysqld.cc:6232 #6 0x000000000060d4e2 in mysqld_main (argc=79, argv=0x284b778) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/mysqld.cc:5651 #7 0x00000000006033a4 in main (argc=9, argv=0x7fffffcd48f8) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/main.cc:25 Thread 20 (Thread 0x7fe467f13710 (LWP 2728)): #0 0x000000328280e034 in __lll_lock_wait () from /lib64/libpthread.so.0 #1 0x000000328280937b in _L_lock_1023 () from /lib64/libpthread.so.0 #2 0x00000032828092fe in pthread_mutex_lock () from /lib64/libpthread.so.0 #3 0x00000000007bf46e in inline_mysql_mutex_lock (that=0x1796a80, src_file=0xf32118 "/home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_plugin.cc", src_line=1085) at /home/ushastry/mybuilds/mysql-5.6.15-release/include/mysql/psi/mysql_thread.h:673 #4 0x00000000007c185d in plugin_unlock (thd=0x0, plugin=0x2a9c3e0) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_plugin.cc:1085 #5 0x000000000082fcea in create_myisam_from_heap (thd=0x2c25650, table=0x2c48fa0, start_recinfo=0x2c49c70, recinfo=0x2c47288, error=135, ignore_last_dup=false, is_duplicate=0x0) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_tmp_table.cc:2042 #6 0x00000000007f6c71 in schema_table_store_record (thd=0x2c25650, table=0x2c48fa0) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_show.cc:2678 #7 0x00000000007f6ab3 in show_status_array (thd=0x2c25650, wild=0x0, variables=0x2c4ec30, value_type=OPT_SESSION, status_var=0x0, prefix=0xf3b7d9 "", table=0x2c48fa0, ucase_names=false, cond=0x0) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_show.cc:2611 #8 0x000000000080518e in fill_variables (thd=0x2c25650, tables=0x2c3c058, cond=0x0) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_show.cc:6471 #9 0x00000000008075a9 in do_fill_table (thd=0x2c25650, table_list=0x2c3c058, join_table=0x2c48040) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_show.cc:7184 #10 0x0000000000807978 in get_schema_tables_result (join=0x2c47408, executed_place=PROCESSED_BY_JOIN_EXEC) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_show.cc:7285 #11 0x00000000007dd157 in JOIN::prepare_result (this=0x2c47408, columns_list=0x7fe467f0f920) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_select.cc:822 #12 0x000000000077ffe5 in JOIN::exec (this=0x2c47408) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_executor.cc:116 #13 0x00000000007ddc58 in mysql_execute_select (thd=0x2c25650, select_lex=0x2c3f248, free_join=true) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_select.cc:1100 #14 0x00000000007ddf4a in mysql_select (thd=0x2c25650, tables=0x2c3c058, wild_num=0, fields=..., conds=0x0, order=0x2c3f410, group=0x2c3f348, having=0x0, select_options=2684620544, result=0x2c473e0, unit=0x2c3ec00, select_lex=0x2c3f248) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_select.cc:1221 #15 0x00000000007dc013 in handle_select (thd=0x2c25650, result=0x2c473e0, setup_tables_done_option=0) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_select.cc:110 #16 0x00000000007b75e8 in execute_sqlcom_select (thd=0x2c25650, all_tables=0x2c3c058) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_parse.cc:5094 #17 0x00000000007b0145 in mysql_execute_command (thd=0x2c25650) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_parse.cc:2642 #18 0x00000000009550f4 in sp_instr_stmt::exec_core (this=0x2c3c5c8, thd=0x2c25650, nextp=0x7fe467f10ec8) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sp_instr.cc:889 #19 0x0000000000954069 in sp_lex_instr::reset_lex_and_exec_core (this=0x2c3c5c8, thd=0x2c25650, nextp=0x7fe467f10ec8, open_tables=false) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sp_instr.cc:390 #20 0x00000000009548dc in sp_lex_instr::validate_lex_and_execute_core (this=0x2c3c5c8, thd=0x2c25650, nextp=0x7fe467f10ec8, open_tables=false) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sp_instr.cc:626 #21 0x0000000000954dfd in sp_instr_stmt::execute (this=0x2c3c5c8, thd=0x2c25650, nextp=0x7fe467f10ec8) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sp_instr.cc:796 #22 0x000000000071190d in sp_head::execute (this=0x2c34a30, thd=0x2c25650, merge_da_on_success=true) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sp_head.cc:645 #23 0x000000000071365b in sp_head::execute_procedure (this=0x2c34a30, thd=0x2c25650, args=0x2c28408) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sp_head.cc:1315 #24 0x00000000007b5a2c in mysql_execute_command (thd=0x2c25650) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_parse.cc:4560 #25 0x00000000007b9bc1 in mysql_parse (thd=0x2c25650, rawbuf=0x2c318c0 "CALL p_show_vars(100)", length=21, parser_state=0x7fe467f12680) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_parse.cc:6235 #26 0x00000000007ad28d in dispatch_command (command=COM_QUERY, thd=0x2c25650, packet=0x2c29681 "CALL p_show_vars(100);", packet_length=22) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_parse.cc:1334 #27 0x00000000007ac412 in do_command (thd=0x2c25650) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_parse.cc:1036 #28 0x0000000000776261 in do_handle_one_connection (thd_arg=0x2c25650) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_connect.cc:982 #29 0x0000000000775d8a in handle_one_connection (arg=0x2c25650) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_connect.cc:898 #30 0x0000000000ad02dd in pfs_spawn_thread (arg=0x2bbfba0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/perfschema/pfs.cc:1858 #31 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #32 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 19 (Thread 0x7fe47005d710 (LWP 2727)): #0 0x000000328280aad0 in pthread_rwlock_wrlock () from /lib64/libpthread.so.0 #1 0x00000000007bf60a in inline_mysql_rwlock_wrlock (that=0x178e5a0, src_file=0xf32118 "/home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_plugin.cc", src_line=1860) at /home/ushastry/mybuilds/mysql-5.6.15-release/include/mysql/psi/mysql_thread.h:937 #2 0x00000000007c3503 in mysql_install_plugin (thd=0x2c1d4e0, name=0x7fe440015930, dl=0x7fe440015940) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_plugin.cc:1860 #3 0x00000000007b6870 in mysql_execute_command (thd=0x2c1d4e0) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_parse.cc:4860 #4 0x00000000009550f4 in sp_instr_stmt::exec_core (this=0x7fe440009478, thd=0x2c1d4e0, nextp=0x7fe47005aec8) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sp_instr.cc:889 #5 0x0000000000954069 in sp_lex_instr::reset_lex_and_exec_core (this=0x7fe440009478, thd=0x2c1d4e0, nextp=0x7fe47005aec8, open_tables=false) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sp_instr.cc:390 #6 0x00000000009548dc in sp_lex_instr::validate_lex_and_execute_core (this=0x7fe440009478, thd=0x2c1d4e0, nextp=0x7fe47005aec8, open_tables=false) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sp_instr.cc:626 #7 0x0000000000954dfd in sp_instr_stmt::execute (this=0x7fe440009478, thd=0x2c1d4e0, nextp=0x7fe47005aec8) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sp_instr.cc:796 #8 0x000000000071190d in sp_head::execute (this=0x7fe440008030, thd=0x2c1d4e0, merge_da_on_success=true) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sp_head.cc:645 #9 0x000000000071365b in sp_head::execute_procedure (this=0x7fe440008030, thd=0x2c1d4e0, args=0x2c20298) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sp_head.cc:1315 #10 0x00000000007b5a2c in mysql_execute_command (thd=0x2c1d4e0) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_parse.cc:4560 #11 0x00000000007b9bc1 in mysql_parse (thd=0x2c1d4e0, rawbuf=0x7fe440004c30 "CALL p_install(100)", length=19, parser_state=0x7fe47005c680) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_parse.cc:6235 #12 0x00000000007ad28d in dispatch_command (command=COM_QUERY, thd=0x2c1d4e0, packet=0x2c21511 "CALL p_install(100);", packet_length=20) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_parse.cc:1334 #13 0x00000000007ac412 in do_command (thd=0x2c1d4e0) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_parse.cc:1036 #14 0x0000000000776261 in do_handle_one_connection (thd_arg=0x2c1d4e0) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_connect.cc:982 #15 0x0000000000775d8a in handle_one_connection (arg=0x2c1d4e0) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_connect.cc:898 #16 0x0000000000ad02dd in pfs_spawn_thread (arg=0x2a98600) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/perfschema/pfs.cc:1858 #17 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #18 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 18 (Thread 0x7fe47009e710 (LWP 2723)): #0 0x000000328280e034 in __lll_lock_wait () from /lib64/libpthread.so.0 #1 0x000000328280937b in _L_lock_1023 () from /lib64/libpthread.so.0 #2 0x00000032828092fe in pthread_mutex_lock () from /lib64/libpthread.so.0 #3 0x00000000007bf46e in inline_mysql_mutex_lock (that=0x1796a80, src_file=0xf32118 "/home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_plugin.cc", src_line=2764) at /home/ushastry/mybuilds/mysql-5.6.15-release/include/mysql/psi/mysql_thread.h:673 #4 0x00000000007c5907 in plugin_thdvar_init (thd=0x2b496a0, enable_plugins=true) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_plugin.cc:2764 #5 0x0000000000768fd2 in THD::init (this=0x2b496a0) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_class.cc:1357 #6 0x0000000000769377 in THD::change_user (this=0x2b496a0) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_class.cc:1451 #7 0x00000000007aca4c in dispatch_command (command=COM_CHANGE_USER, thd=0x2b496a0, packet=0x2c194d1 "root", packet_length=141) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_parse.cc:1236 #8 0x00000000007ac412 in do_command (thd=0x2b496a0) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_parse.cc:1036 #9 0x0000000000776261 in do_handle_one_connection (thd_arg=0x2b496a0) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_connect.cc:982 #10 0x0000000000775d8a in handle_one_connection (arg=0x2b496a0) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/sql_connect.cc:898 #11 0x0000000000ad02dd in pfs_spawn_thread (arg=0x2a97a10) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/perfschema/pfs.cc:1858 #12 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #13 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 17 (Thread 0x7fe4700df710 (LWP 2719)): #0 0x000000328280f265 in sigwait () from /lib64/libpthread.so.0 #1 0x0000000000609832 in signal_hand (arg=0x0) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/mysqld.cc:3179 #2 0x0000000000ad02dd in pfs_spawn_thread (arg=0x2a90e40) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/perfschema/pfs.cc:1858 #3 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #4 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 16 (Thread 0x7fe4577fe710 (LWP 2718)): #0 0x000000328280b7a9 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000000000b60647 in os_cond_wait_timed (cond=0x2a96b50, fast_mutex=0x2a96b10, abstime=0x7fe4577fdda0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0sync.cc:177 #2 0x0000000000b60e68 in os_event_wait_time_low (event=0x2a96b10, time_in_usec=5000000, reset_sig_count=1) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0sync.cc:723 #3 0x0000000000c5a39c in ib_wqueue_timedwait (wq=0x2a94608, wait_in_usecs=5000000) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/ut/ut0wqueue.cc:154 #4 0x0000000000d2cd48 in fts_optimize_thread (arg=0x2a94608) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/fts/fts0opt.cc:2994 #5 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #6 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 15 (Thread 0x7fe457fff710 (LWP 2717)): #0 0x000000328280b7a9 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000000000b60647 in os_cond_wait_timed (cond=0x2a74ad0, fast_mutex=0x2a74a90, abstime=0x7fe457ffee50) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0sync.cc:177 #2 0x0000000000b60e68 in os_event_wait_time_low (event=0x2a74a90, time_in_usec=10000000, reset_sig_count=1) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0sync.cc:723 #3 0x0000000000cf2271 in dict_stats_thread (arg=0x0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/dict/dict0stats_bg.cc:349 #4 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #5 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 14 (Thread 0x7fe464ae4710 (LWP 2716)): #0 0x000000328280b43c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000000000b6073d in os_cond_wait (cond=0x2956ea0, fast_mutex=0x2956e60) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0sync.cc:214 #2 0x0000000000b60c8b in os_event_wait_low (event=0x2956e60, reset_sig_count=1) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0sync.cc:610 #3 0x0000000000ca963b in buf_dump_thread (arg=0x0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/buf/buf0dump.cc:594 #4 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #5 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 13 (Thread 0x7fe4652e5710 (LWP 2715)): #0 0x0000003281cda093 in select () from /lib64/libc.so.6 #1 0x0000000000b619a7 in os_thread_sleep (tm=1000000) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0thread.cc:258 #2 0x0000000000cb041f in page_cleaner_sleep_if_needed (next_loop_time=1388142109487) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/buf/buf0flu.cc:2379 #3 0x0000000000cb0507 in buf_flush_page_cleaner_thread (arg=0x0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/buf/buf0flu.cc:2420 #4 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #5 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 12 (Thread 0x7fe465ae6710 (LWP 2714)): #0 0x000000328280b43c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000000000b6073d in os_cond_wait (cond=0x2956cf0, fast_mutex=0x2956cb0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0sync.cc:214 #2 0x0000000000b60c8b in os_event_wait_low (event=0x2956cb0, reset_sig_count=1) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0sync.cc:610 #3 0x0000000000c1a4a3 in srv_purge_coordinator_suspend (slot=0x2956ac0, rseg_history_len=0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/srv/srv0srv.cc:2631 #4 0x0000000000c1a954 in srv_purge_coordinator_thread (arg=0x0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/srv/srv0srv.cc:2748 #5 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #6 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 11 (Thread 0x7fe4662e7710 (LWP 2713)): #0 0x0000003281cda093 in select () from /lib64/libc.so.6 #1 0x0000000000b619a7 in os_thread_sleep (tm=1000000) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0thread.cc:258 #2 0x0000000000c19b43 in srv_master_sleep () at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/srv/srv0srv.cc:2294 #3 0x0000000000c19c56 in srv_master_thread (arg=0x0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/srv/srv0srv.cc:2338 #4 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #5 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 10 (Thread 0x7fe466ae8710 (LWP 2712)): #0 0x000000328280b7a9 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000000000b60647 in os_cond_wait_timed (cond=0x2956e10, fast_mutex=0x2956dd0, abstime=0x7fe466ae7de0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0sync.cc:177 #2 0x0000000000b60e68 in os_event_wait_time_low (event=0x2956dd0, time_in_usec=5000000, reset_sig_count=1) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0sync.cc:723 #3 0x0000000000c187dd in srv_monitor_thread (arg=0x0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/srv/srv0srv.cc:1532 #4 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #5 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 9 (Thread 0x7fe4672e9710 (LWP 2711)): #0 0x000000328280b7a9 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000000000b60647 in os_cond_wait_timed (cond=0x2956d80, fast_mutex=0x2956d40, abstime=0x7fe4672e8df0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0sync.cc:177 #2 0x0000000000b60e68 in os_event_wait_time_low (event=0x2956d40, time_in_usec=1000000, reset_sig_count=1) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0sync.cc:723 #3 0x0000000000c18d85 in srv_error_monitor_thread (arg=0x0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/srv/srv0srv.cc:1763 #4 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #5 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 8 (Thread 0x7fe467aea710 (LWP 2710)): #0 0x000000328280b7a9 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000000000b60647 in os_cond_wait_timed (cond=0x2a6b010, fast_mutex=0x2a6afd0, abstime=0x7fe467ae9e30) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0sync.cc:177 #2 0x0000000000b60e68 in os_event_wait_time_low (event=0x2a6afd0, time_in_usec=1000000, reset_sig_count=1) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0sync.cc:723 #3 0x0000000000b41c48 in lock_wait_timeout_thread (arg=0x0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/lock/lock0wait.cc:503 #4 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #5 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 7 (Thread 0x7fe468714710 (LWP 2708)): #0 0x0000003281800614 in ?? () from /lib64/libaio.so.1 #1 0x0000000000b5e372 in os_aio_linux_collect (array=0x29ae4d0, segment=1, seg_size=256) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0file.cc:4918 #2 0x0000000000b5e714 in os_aio_linux_handle (global_seg=5, message1=0x7fe468713e40, message2=0x7fe468713e38, type=0x7fe468713e30) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0file.cc:5062 #3 0x0000000000d02ea8 in fil_aio_wait (segment=5) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/fil/fil0fil.cc:5568 #4 0x0000000000c1d0c1 in io_handler_thread (arg=0x17cb8c8) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/srv/srv0start.cc:480 #5 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #6 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 6 (Thread 0x7fe468f15710 (LWP 2707)): #0 0x0000003281800614 in ?? () from /lib64/libaio.so.1 #1 0x0000000000b5e372 in os_aio_linux_collect (array=0x29ae4d0, segment=0, seg_size=256) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0file.cc:4918 #2 0x0000000000b5e714 in os_aio_linux_handle (global_seg=4, message1=0x7fe468f14e40, message2=0x7fe468f14e38, type=0x7fe468f14e30) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0file.cc:5062 #3 0x0000000000d02ea8 in fil_aio_wait (segment=4) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/fil/fil0fil.cc:5568 #4 0x0000000000c1d0c1 in io_handler_thread (arg=0x17cb8c0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/srv/srv0start.cc:480 #5 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #6 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 5 (Thread 0x7fe469716710 (LWP 2706)): #0 0x0000003281800614 in ?? () from /lib64/libaio.so.1 #1 0x0000000000b5e372 in os_aio_linux_collect (array=0x294bc30, segment=1, seg_size=256) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0file.cc:4918 #2 0x0000000000b5e714 in os_aio_linux_handle (global_seg=3, message1=0x7fe469715e40, message2=0x7fe469715e38, type=0x7fe469715e30) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0file.cc:5062 #3 0x0000000000d02ea8 in fil_aio_wait (segment=3) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/fil/fil0fil.cc:5568 #4 0x0000000000c1d0c1 in io_handler_thread (arg=0x17cb8b8) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/srv/srv0start.cc:480 #5 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #6 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 4 (Thread 0x7fe469f17710 (LWP 2705)): #0 0x0000003281800614 in ?? () from /lib64/libaio.so.1 #1 0x0000000000b5e372 in os_aio_linux_collect (array=0x294bc30, segment=0, seg_size=256) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0file.cc:4918 #2 0x0000000000b5e714 in os_aio_linux_handle (global_seg=2, message1=0x7fe469f16e40, message2=0x7fe469f16e38, type=0x7fe469f16e30) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0file.cc:5062 #3 0x0000000000d02ea8 in fil_aio_wait (segment=2) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/fil/fil0fil.cc:5568 #4 0x0000000000c1d0c1 in io_handler_thread (arg=0x17cb8b0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/srv/srv0start.cc:480 #5 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #6 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 3 (Thread 0x7fe46a718710 (LWP 2704)): #0 0x0000003281800614 in ?? () from /lib64/libaio.so.1 #1 0x0000000000b5e372 in os_aio_linux_collect (array=0x2993f50, segment=0, seg_size=256) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0file.cc:4918 #2 0x0000000000b5e714 in os_aio_linux_handle (global_seg=1, message1=0x7fe46a717e40, message2=0x7fe46a717e38, type=0x7fe46a717e30) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0file.cc:5062 #3 0x0000000000d02ea8 in fil_aio_wait (segment=1) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/fil/fil0fil.cc:5568 #4 0x0000000000c1d0c1 in io_handler_thread (arg=0x17cb8a8) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/srv/srv0start.cc:480 #5 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #6 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 2 (Thread 0x7fe473c5d710 (LWP 2703)): #0 0x0000003281800614 in ?? () from /lib64/libaio.so.1 #1 0x0000000000b5e372 in os_aio_linux_collect (array=0x29a1210, segment=0, seg_size=256) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0file.cc:4918 #2 0x0000000000b5e714 in os_aio_linux_handle (global_seg=0, message1=0x7fe473c5ce40, message2=0x7fe473c5ce38, type=0x7fe473c5ce30) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/os/os0file.cc:5062 #3 0x0000000000d02ea8 in fil_aio_wait (segment=0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/fil/fil0fil.cc:5568 #4 0x0000000000c1d0c1 in io_handler_thread (arg=0x17cb8a0) at /home/ushastry/mybuilds/mysql-5.6.15-release/storage/innobase/srv/srv0start.cc:480 #5 0x00000032828077e1 in start_thread () from /lib64/libpthread.so.0 #6 0x0000003281ce153d in clone () from /lib64/libc.so.6 Thread 1 (Thread 0x7fe473c5f720 (LWP 2701)): #0 0x000000328280c69c in pthread_kill () from /lib64/libpthread.so.0 #1 0x0000000000a6915e in my_write_core (sig=6) at /home/ushastry/mybuilds/mysql-5.6.15-release/mysys/stacktrace.c:422 #2 0x0000000000708d26 in handle_fatal_signal (sig=6) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/signal_handler.cc:248 #3 #4 0x0000003281cd7e33 in poll () from /lib64/libc.so.6 #5 0x000000000060e123 in handle_connections_sockets () at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/mysqld.cc:6232 #6 0x000000000060d4e2 in mysqld_main (argc=79, argv=0x284b778) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/mysqld.cc:5651 #7 0x00000000006033a4 in main (argc=9, argv=0x7fffffcd48f8) at /home/ushastry/mybuilds/mysql-5.6.15-release/sql/main.cc:25 -------------------------------------------------------------------------- The servers were restarted 0 times Spent 0.000 of 969 seconds executing testcases Completed: Failed 1/1 tests, 0.00% were successful. Failing test(s): main.71236 The log files in var/log may give you some hint of what went wrong. If you want to report this error, please read first the documentation at http://dev.mysql.com/doc/mysql/en/mysql-test-suite.html mysql-test-run: *** ERROR: there were failing test cases