MySQL Bugs: #72998: mysqld crash

Bug #72998	mysqld crash
Submitted:	13 Jun 2014 10:34	Modified:	13 Jul 2014 12:06
Reporter:	Arhi Smecevilli	Email Updates:
Status:	No Feedback	Impact on me:	None
Category:	MySQL Server	Severity:	S2 (Serious)
Version:	5.6.16	OS:	Linux (2.6.32-431.5.1.el6.x86_64)
Assigned to:		CPU Architecture:	Any

Description:
09:26:22 UTC - mysqld got signal 6 ;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured. This error can also be caused by malfunctioning hardware.
We will try our best to scrape up some info that will hopefully help
diagnose the problem, but since we have already crashed,
something is definitely wrong and this may fail.

key_buffer_size=8388608
read_buffer_size=131072
max_used_connections=14
max_threads=1000
thread_count=14
connection_count=14
It is possible that mysqld could use up to
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 2197879 K  bytes of memory
Hope that's ok; if not, decrease some variables in the equation.

Thread pointer: 0x5689dd0
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = 7f638051ce18 thread_stack 0x40000
/usr/sbin/mysqld(my_print_stacktrace+0x35)[0x8d0f15]
/usr/sbin/mysqld(handle_fatal_signal+0x4a4)[0x65f9b4]
/lib64/libpthread.so.0(+0xf710)[0x7f6384540710]
/lib64/libc.so.6(gsignal+0x35)[0x7f63831eb925]
/lib64/libc.so.6(abort+0x175)[0x7f63831ed105]
/usr/sbin/mysqld[0x9f13db]
/usr/sbin/mysqld[0x9f1907]
/usr/sbin/mysqld[0x9e0c35]
/usr/sbin/mysqld[0x98bbf1]
/usr/sbin/mysqld[0x98cb3f]
/usr/sbin/mysqld[0x98df7b]
/usr/sbin/mysqld[0x956b10]
/usr/sbin/mysqld[0x957095]
/usr/sbin/mysqld[0xa2fe91]
/usr/sbin/mysqld[0x8f9b5f]
/usr/sbin/mysqld(_ZN7handler7ha_openEP5TABLEPKcii+0x3e)[0x5a4b9e]
/usr/sbin/mysqld(_Z21open_table_from_shareP3THDP11TABLE_SHAREPKcjjjP5TABLEb+0x624)[0x765db4]
/usr/sbin/mysqld(_Z10open_tableP3THDP10TABLE_LISTP18Open_table_context+0x1eb)[0x6968cb]
/usr/sbin/mysqld(_Z11open_tablesP3THDPP10TABLE_LISTPjjP19Prelocking_strategy+0xcaa)[0x69915a]
/usr/sbin/mysqld(_Z20open_and_lock_tablesP3THDP10TABLE_LISTbjP19Prelocking_strategy+0x44)[0x699324]
/usr/sbin/mysqld(_ZN22Sql_cmd_truncate_table16handler_truncateEP3THDP10TABLE_LISTb+0x7c)[0x85665c]
/usr/sbin/mysqld(_ZN22Sql_cmd_truncate_table14truncate_tableEP3THDP10TABLE_LIST+0x2a8)[0x856df8]
/usr/sbin/mysqld(_ZN22Sql_cmd_truncate_table7executeEP3THD+0x5e)[0x856eee]
/usr/sbin/mysqld(_Z21mysql_execute_commandP3THD+0x771)[0x6dabe1]
/usr/sbin/mysqld(_ZN18Prepared_statement7executeEP6Stringb+0x426)[0x6edbc6]
/usr/sbin/mysqld(_ZN18Prepared_statement12execute_loopEP6StringbPhS2_+0xb2)[0x6f1392]
/usr/sbin/mysqld(_Z22mysql_sql_stmt_executeP3THD+0xbe)[0x6f185e]
/usr/sbin/mysqld(_Z21mysql_execute_commandP3THD+0x122a)[0x6db69a]
/usr/sbin/mysqld(_ZN13sp_instr_stmt9exec_coreEP3THDPj+0x60)[0x80b950]
/usr/sbin/mysqld(_ZN12sp_lex_instr23reset_lex_and_exec_coreEP3THDPjb+0x228)[0x80bc88]
/usr/sbin/mysqld(_ZN12sp_lex_instr29validate_lex_and_execute_coreEP3THDPjb+0x8f)[0x80da7f]
/usr/sbin/mysqld(_ZN13sp_instr_stmt7executeEP3THDPj+0x1b0)[0x80e160]
/usr/sbin/mysqld(_ZN7sp_head7executeEP3THDb+0x782)[0x665ef2]
/usr/sbin/mysqld(_ZN7sp_head17execute_procedureEP3THDP4ListI4ItemE+0x6d7)[0x667807]
/usr/sbin/mysqld(_Z21mysql_execute_commandP3THD+0x143b)[0x6db8ab]
/usr/sbin/mysqld(_Z11mysql_parseP3THDPcjP12Parser_state+0x32f)[0x6df27f]
/usr/sbin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcj+0x1407)[0x6e0777]
/usr/sbin/mysqld(_Z24do_handle_one_connectionP3THD+0xcf)[0x6ad6ff]
/usr/sbin/mysqld(handle_one_connection+0x47)[0x6ad827]
/usr/sbin/mysqld(pfs_spawn_thread+0x12a)[0xaf619a]
/lib64/libpthread.so.0(+0x79d1)[0x7f63845389d1]
/lib64/libc.so.6(clone+0x6d)[0x7f63832a1b6d]

Trying to get some variables.
Some pointers may be invalid and cause the dump to abort.
Query (7f62a07f51e0): is an invalid pointer
Connection ID (thread ID): 15
Status: NOT_KILLED

09:37:12 UTC - mysqld got signal 6 ;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured. This error can also be caused by malfunctioning hardware.
We will try our best to scrape up some info that will hopefully help
diagnose the problem, but since we have already crashed,
something is definitely wrong and this may fail.

key_buffer_size=8388608
read_buffer_size=131072
max_used_connections=13
max_threads=1000
thread_count=13
connection_count=13
It is possible that mysqld could use up to
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 2197879 K  bytes of memory
Hope that's ok; if not, decrease some variables in the equation.

Thread pointer: 0x691a5c0
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = 7f0a29186e18 thread_stack 0x40000
/usr/sbin/mysqld(my_print_stacktrace+0x35)[0x8d0f15]
/usr/sbin/mysqld(handle_fatal_signal+0x4a4)[0x65f9b4]
/lib64/libpthread.so.0(+0xf710)[0x7f0ae474c710]
/lib64/libc.so.6(gsignal+0x35)[0x7f0ae33f7925]
/lib64/libc.so.6(abort+0x175)[0x7f0ae33f9105]
/usr/sbin/mysqld[0x9f13db]
/usr/sbin/mysqld[0x9f1907]
/usr/sbin/mysqld[0x9e0c35]
/usr/sbin/mysqld[0x98bbf1]
/usr/sbin/mysqld[0x98cb3f]
/usr/sbin/mysqld[0x98df7b]
/usr/sbin/mysqld[0x956b10]
/usr/sbin/mysqld[0x957095]
/usr/sbin/mysqld[0xa2fe91]
/usr/sbin/mysqld[0x8f9b5f]
/usr/sbin/mysqld(_ZN7handler7ha_openEP5TABLEPKcii+0x3e)[0x5a4b9e]
/usr/sbin/mysqld(_Z21open_table_from_shareP3THDP11TABLE_SHAREPKcjjjP5TABLEb+0x624)[0x765db4]
/usr/sbin/mysqld(_Z10open_tableP3THDP10TABLE_LISTP18Open_table_context+0x1eb)[0x6968cb]
/usr/sbin/mysqld(_Z11open_tablesP3THDPP10TABLE_LISTPjjP19Prelocking_strategy+0xcaa)[0x69915a]
/usr/sbin/mysqld(_Z30open_normal_and_derived_tablesP3THDP10TABLE_LISTj+0x4f)[0x69927f]
/usr/sbin/mysqld(_Z18mysqld_list_fieldsP3THDP10TABLE_LISTPKc+0x25)[0x7129f5]
/usr/sbin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcj+0x2695)[0x6e1a05]
/usr/sbin/mysqld(_Z24do_handle_one_connectionP3THD+0xcf)[0x6ad6ff]
/usr/sbin/mysqld(handle_one_connection+0x47)[0x6ad827]
/usr/sbin/mysqld(pfs_spawn_thread+0x12a)[0xaf619a]
/lib64/libpthread.so.0(+0x79d1)[0x7f0ae47449d1]
/lib64/libc.so.6(clone+0x6d)[0x7f0ae34adb6d]

Trying to get some variables.
Some pointers may be invalid and cause the dump to abort.
Query (7f09cc006de0): is an invalid pointer
Connection ID (thread ID): 17
Status: NOT_KILLED

How to repeat:
version:  5.6.16 (from oracle yum repository, rhel 6,  2.6.32-431.5.1.el6.x86_64, 32G ram, not MySQL dedicated)

config:

[mysqld_safe]
open_files=65000

[mysqld]
open_files=65000
innodb_buffer_pool_size = 2G
innodb_log_file_size=2G
join_buffer_size = 128M
sort_buffer_size = 2M
read_rnd_buffer_size = 2M
datadir=/var/lib/mysql
socket=/var/lib/mysql/mysql.sock
bind = 10.0.0.108
max-connections = 1000
symbolic-links=0
sql_mode=NO_ENGINE_SUBSTITUTION,STRICT_TRANS_TABLES

[mysqld_safe]
log-error=/var/log/mysqld.log
pid-file=/var/run/mysqld/mysqld.pid

Suggested fix:
?!

The crash occurred when some stored procedure was executing TRUNCATE TABLE in a prepared statement.

Can you kindly upload the full mysql error log so we can see which assertion failed?

second crash is problem caused by some GUI or mysql client running without the --no-auto-rehash option.  I guess a table is really corrupted.

No feedback was provided for this bug for over a month, so it is
being suspended automatically. If you are able to provide the
information that was originally requested, please do so and change
the status of the bug back to "Open".