Description:
federated.federated_server w1 [ fail ]
Test ended at 2016-03-08 00:17:50
CURRENT_TEST: federated.federated_server
mysqltest: At line 334: query 'call p1()' failed: 2013: Lost connection to MySQL server during query
Version: '5.7.11-log' socket: '/home/ubuntu/mysql-server/mysql-test/var/tmp/1/mysqld.1.sock' port: 13000 Source distribution
2016-03-08 09:17:50 0x3fff27fff18006:17:50 UTC - mysqld got signal 11 ;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured. This error can also be caused by malfunctioning hardware.
Attempting to collect some information that could help diagnose the problem.
As this is a crash and something is definitely wrong, the information
collection process might fail.
InnoDB: Assertion failure in thread 70365120295296 in file que0que.cc line 745
key_buffer_size=1048576
read_buffer_size=131072
max_used_connections=5
InnoDB: Failing assertion: thr->is_active
max_threads=151
thread_count=3
connection_count=3
It is possible that mysqld could use up to
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 61020 K bytes of memory
Hope that's ok; if not, decrease some variables in the equation.
Thread pointer: 0x3fff200008c0
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
2016-03-08 09:17:50 0x3fff455ef180 InnoDB: Assertion failure in thread 70365613060480 in file trx0purge.cc line 1770
InnoDB: Failing assertion: srv_get_task_queue_length() == 0
InnoDB: We intentionally generate a memory trap.
InnoDB: Submit a detailed bug report to http://bugs.mysql.com.
InnoDB: If you get repeated assertion failures or crashes, even
InnoDB: immediately after the mysqld startup, there may be
InnoDB: corruption in the InnoDB tablespace. Please refer to
InnoDB: http://dev.mysql.com/doc/refman/5.7/en/forcing-innodb-recovery.html
InnoDB: about forcing recovery.
stack_bottom = 3fff44dee670 thread_stack 0x40000
InnoDB: We intentionally generate a memory trap.
InnoDB: Submit a detailed bug report to http://bugs.mysql.com.
InnoDB: If you get repeated assertion failures or crashes, even
InnoDB: immediately after the mysqld startup, there may be
InnoDB: corruption in the InnoDB tablespace. Please refer to
InnoDB: http://dev.mysql.com/doc/refman/5.7/en/forcing-innodb-recovery.html
InnoDB: about forcing recovery.
Fatal signal 6 while backtracing
safe_process[83378]: Child process: 83384, killed by signal: 6
----------SERVER LOG END-------------
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/powerpc64le-linux-gnu/libthread_db.so.1".
Can't read symbols from system-supplied DSO at 0x3fff78690000: File truncated
Core was generated by `/home/ubuntu/mysql-server/sql/mysqld --defaults-group-suffix=.1 --defaults-file'.
Program terminated with signal SIGABRT, Aborted.
#0 0x00003fff77ef0a88 in __GI_raise (sig=<optimized out>) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56
56 ../nptl/sysdeps/unix/sysv/linux/raise.c: No such file or directory.
#0 0x00003fff77ef0a88 in __GI_raise (sig=<optimized out>) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56
#1 0x00003fff77ef686c in __GI_abort () at abort.c:89
#2 0x0000000010370dd4 in ut_dbg_assertion_failed (expr=0x113346f0 "srv_get_task_queue_length() == 0", file=0x113373d0 "/home/ubuntu/mysql-server/storage/innobase/trx/trx0purge.cc", line=1770) at /home/ubuntu/mysql-server/storage/innobase/ut/ut0dbg.cc:67
#3 0x0000000010efc3b4 in trx_purge_wait_for_workers_to_complete (purge_sys=0x100090954c8) at /home/ubuntu/mysql-server/storage/innobase/trx/trx0purge.cc:1770
#4 trx_purge (n_purge_threads=<optimized out>, batch_size=300, truncate=<optimized out>) at /home/ubuntu/mysql-server/storage/innobase/trx/trx0purge.cc:1866
#5 0x0000000010ed0f40 in srv_do_purge (n_total_purged=<synthetic pointer>, n_threads=4) at /home/ubuntu/mysql-server/storage/innobase/srv/srv0srv.cc:2608
#6 srv_purge_coordinator_thread (arg=<optimized out>) at /home/ubuntu/mysql-server/storage/innobase/srv/srv0srv.cc:2780
#7 0x00003fff782f89d8 in start_thread (arg=0x3fff455ef180) at pthread_create.c:314
#8 0x00003fff77fcef00 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:104
(gdb) up
#3 0x0000000010efc3b4 in trx_purge_wait_for_workers_to_complete (purge_sys=0x100090954c8) at /home/ubuntu/mysql-server/storage/innobase/trx/trx0purge.cc:1770
1770 ut_a(srv_get_task_queue_length() == 0);
(gdb) p srv_sys->tasks
$1 = {count = 18446744073709551615, start = 0x0, end = 0x0, node = &que_thr_t::queue}
(gdb) p n_submitted
$2 = 138056
(gdb) p purge_sys->n_completed
$3 = 138056
(gdb) p purge_sys->n_submitted
$4 = 138056
(gdb) p srv_sys->n_sys_threads
$7 = 5
(gdb) p srv_sys->sys_threads[4]
$9 = {type = SRV_WORKER, in_use = 1, suspended = 1, suspend_time = 0, wait_timeout = 0, event = 0x10008dd7518, thr = 0x0}
(gdb) p srv_sys->sys_threads[3]
$10 = {type = SRV_WORKER, in_use = 1, suspended = 0, suspend_time = 0, wait_timeout = 0, event = 0x10008dd7488, thr = 0x0}
(gdb) p srv_sys->sys_threads[2]
$11 = {type = SRV_WORKER, in_use = 1, suspended = 0, suspend_time = 0, wait_timeout = 0, event = 0x10008dd73f8, thr = 0x0}
(gdb) p srv_sys->sys_threads[1]
$12 = {type = SRV_PURGE, in_use = 1, suspended = 0, suspend_time = 0, wait_timeout = 0, event = 0x10008dd7368, thr = 0x0}
(gdb) p srv_sys->sys_threads[0]
$13 = {type = SRV_MASTER, in_use = 1, suspended = 0, suspend_time = 0, wait_timeout = 0, event = 0x10008dd72d8, thr = 0x0}
(gdb) p srv_n_purge_threads
$14 = 4
(gdb) p srv_sys->n_threads_active[SRV_WORKER]
$15 = 2
How to repeat:
mtr failure on power8
Description: federated.federated_server w1 [ fail ] Test ended at 2016-03-08 00:17:50 CURRENT_TEST: federated.federated_server mysqltest: At line 334: query 'call p1()' failed: 2013: Lost connection to MySQL server during query Version: '5.7.11-log' socket: '/home/ubuntu/mysql-server/mysql-test/var/tmp/1/mysqld.1.sock' port: 13000 Source distribution 2016-03-08 09:17:50 0x3fff27fff18006:17:50 UTC - mysqld got signal 11 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. Attempting to collect some information that could help diagnose the problem. As this is a crash and something is definitely wrong, the information collection process might fail. InnoDB: Assertion failure in thread 70365120295296 in file que0que.cc line 745 key_buffer_size=1048576 read_buffer_size=131072 max_used_connections=5 InnoDB: Failing assertion: thr->is_active max_threads=151 thread_count=3 connection_count=3 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 61020 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x3fff200008c0 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... 2016-03-08 09:17:50 0x3fff455ef180 InnoDB: Assertion failure in thread 70365613060480 in file trx0purge.cc line 1770 InnoDB: Failing assertion: srv_get_task_queue_length() == 0 InnoDB: We intentionally generate a memory trap. InnoDB: Submit a detailed bug report to http://bugs.mysql.com. InnoDB: If you get repeated assertion failures or crashes, even InnoDB: immediately after the mysqld startup, there may be InnoDB: corruption in the InnoDB tablespace. Please refer to InnoDB: http://dev.mysql.com/doc/refman/5.7/en/forcing-innodb-recovery.html InnoDB: about forcing recovery. stack_bottom = 3fff44dee670 thread_stack 0x40000 InnoDB: We intentionally generate a memory trap. InnoDB: Submit a detailed bug report to http://bugs.mysql.com. InnoDB: If you get repeated assertion failures or crashes, even InnoDB: immediately after the mysqld startup, there may be InnoDB: corruption in the InnoDB tablespace. Please refer to InnoDB: http://dev.mysql.com/doc/refman/5.7/en/forcing-innodb-recovery.html InnoDB: about forcing recovery. Fatal signal 6 while backtracing safe_process[83378]: Child process: 83384, killed by signal: 6 ----------SERVER LOG END------------- [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/powerpc64le-linux-gnu/libthread_db.so.1". Can't read symbols from system-supplied DSO at 0x3fff78690000: File truncated Core was generated by `/home/ubuntu/mysql-server/sql/mysqld --defaults-group-suffix=.1 --defaults-file'. Program terminated with signal SIGABRT, Aborted. #0 0x00003fff77ef0a88 in __GI_raise (sig=<optimized out>) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56 56 ../nptl/sysdeps/unix/sysv/linux/raise.c: No such file or directory. #0 0x00003fff77ef0a88 in __GI_raise (sig=<optimized out>) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56 #1 0x00003fff77ef686c in __GI_abort () at abort.c:89 #2 0x0000000010370dd4 in ut_dbg_assertion_failed (expr=0x113346f0 "srv_get_task_queue_length() == 0", file=0x113373d0 "/home/ubuntu/mysql-server/storage/innobase/trx/trx0purge.cc", line=1770) at /home/ubuntu/mysql-server/storage/innobase/ut/ut0dbg.cc:67 #3 0x0000000010efc3b4 in trx_purge_wait_for_workers_to_complete (purge_sys=0x100090954c8) at /home/ubuntu/mysql-server/storage/innobase/trx/trx0purge.cc:1770 #4 trx_purge (n_purge_threads=<optimized out>, batch_size=300, truncate=<optimized out>) at /home/ubuntu/mysql-server/storage/innobase/trx/trx0purge.cc:1866 #5 0x0000000010ed0f40 in srv_do_purge (n_total_purged=<synthetic pointer>, n_threads=4) at /home/ubuntu/mysql-server/storage/innobase/srv/srv0srv.cc:2608 #6 srv_purge_coordinator_thread (arg=<optimized out>) at /home/ubuntu/mysql-server/storage/innobase/srv/srv0srv.cc:2780 #7 0x00003fff782f89d8 in start_thread (arg=0x3fff455ef180) at pthread_create.c:314 #8 0x00003fff77fcef00 in clone () at ../sysdeps/unix/sysv/linux/powerpc/powerpc64/clone.S:104 (gdb) up #3 0x0000000010efc3b4 in trx_purge_wait_for_workers_to_complete (purge_sys=0x100090954c8) at /home/ubuntu/mysql-server/storage/innobase/trx/trx0purge.cc:1770 1770 ut_a(srv_get_task_queue_length() == 0); (gdb) p srv_sys->tasks $1 = {count = 18446744073709551615, start = 0x0, end = 0x0, node = &que_thr_t::queue} (gdb) p n_submitted $2 = 138056 (gdb) p purge_sys->n_completed $3 = 138056 (gdb) p purge_sys->n_submitted $4 = 138056 (gdb) p srv_sys->n_sys_threads $7 = 5 (gdb) p srv_sys->sys_threads[4] $9 = {type = SRV_WORKER, in_use = 1, suspended = 1, suspend_time = 0, wait_timeout = 0, event = 0x10008dd7518, thr = 0x0} (gdb) p srv_sys->sys_threads[3] $10 = {type = SRV_WORKER, in_use = 1, suspended = 0, suspend_time = 0, wait_timeout = 0, event = 0x10008dd7488, thr = 0x0} (gdb) p srv_sys->sys_threads[2] $11 = {type = SRV_WORKER, in_use = 1, suspended = 0, suspend_time = 0, wait_timeout = 0, event = 0x10008dd73f8, thr = 0x0} (gdb) p srv_sys->sys_threads[1] $12 = {type = SRV_PURGE, in_use = 1, suspended = 0, suspend_time = 0, wait_timeout = 0, event = 0x10008dd7368, thr = 0x0} (gdb) p srv_sys->sys_threads[0] $13 = {type = SRV_MASTER, in_use = 1, suspended = 0, suspend_time = 0, wait_timeout = 0, event = 0x10008dd72d8, thr = 0x0} (gdb) p srv_n_purge_threads $14 = 4 (gdb) p srv_sys->n_threads_active[SRV_WORKER] $15 = 2 How to repeat: mtr failure on power8