Server log from this test: 100324 18:49:20 [Warning] '--default-character-set' is deprecated and will be removed in a future release. Please use '--character-set-server' instead. 100324 18:49:20 [Note] Plugin 'FEDERATED' is disabled. 100324 18:49:20 [Note] Plugin 'InnoDB' is disabled. 100324 18:49:20 [Note] Plugin 'ndbcluster' is disabled. 100324 18:49:20 [Note] Event Scheduler: Loaded 0 events 100324 18:49:20 [Note] /mysql-5.1/sql/mysqld: ready for connections. Version: '5.1.46-gcov-debug-log' socket: '/mysql-5.1/mysql-test/var/tmp/mysqld.1.sock' port: 13000 Source distribution 100324 18:49:20 - mysqld got signal 11 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. key_buffer_size=1048576 read_buffer_size=131072 max_used_connections=1 max_threads=151 threads_connected=1 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 59976 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. thd: 0x97e07d8 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0xb6fcb38c thread_stack 0x30000 /mysql-5.1/sql/mysqld(my_print_stacktrace+0x42)[0x8cbd71e] /mysql-5.1/sql/mysqld(handle_segfault+0x4a8)[0x83cf5bd] [0xd16400] /mysql-5.1/sql/mysqld[0x850c4d6] /mysql-5.1/sql/mysqld[0x8506d27] /mysql-5.1/sql/mysqld(_Z10sub_selectP4JOINP13st_join_tableb+0x274)[0x85065da] /mysql-5.1/sql/mysqld[0x8505a33] /mysql-5.1/sql/mysqld(_ZN4JOIN4execEv+0x142f)[0x84d8475] /mysql-5.1/sql/mysqld(_ZN30subselect_single_select_engine4execEv+0xa0a)[0x833453a] /mysql-5.1/sql/mysqld(_ZN14Item_subselect4execEv+0x13f)[0x8328ad1] /mysql-5.1/sql/mysqld(_ZN17Item_in_subselect8val_boolEv+0x88)[0x832cb80] /mysql-5.1/sql/mysqld(_ZN4Item15val_bool_resultEv+0x34)[0x823e536] /mysql-5.1/sql/mysqld(_ZN17Item_in_optimizer7val_intEv+0x472)[0x82a4086] /mysql-5.1/sql/mysqld[0x850b980] /mysql-5.1/sql/mysqld(_Z10sub_selectP4JOINP13st_join_tableb+0x5d)[0x85063c3] /mysql-5.1/sql/mysqld[0x8505a99] /mysql-5.1/sql/mysqld(_ZN4JOIN4execEv+0x4460)[0x84db4a6] /mysql-5.1/sql/mysqld(_Z12mysql_selectP3THDPPP4ItemP10TABLE_LISTjR4ListIS1_ES2_jP8st_orderSB_S2_SB_yP13select_resultP18st_select_lex_unitP13st_select_lex+0x658)[0x84dc3dd] /mysql-5.1/sql/mysqld(_Z13handle_selectP3THDP6st_lexP13select_resultm+0x31e)[0x84cd9c5] /mysql-5.1/sql/mysqld[0x8408425] /mysql-5.1/sql/mysqld(_Z21mysql_execute_commandP3THD+0x1116)[0x83f5598] /mysql-5.1/sql/mysqld(_Z11mysql_parseP3THDPKcjPS2_+0x58d)[0x840cb28] /mysql-5.1/sql/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcj+0x167f)[0x83f09d8] /mysql-5.1/sql/mysqld(_Z10do_commandP3THD+0x4f6)[0x83eec2f] /mysql-5.1/sql/mysqld(handle_one_connection+0x2fe)[0x83eb29b] /lib/tls/i686/cmov/libpthread.so.0[0x8ab80e] /lib/tls/i686/cmov/libc.so.6(clone+0x5e)[0x28c8de] Trying to get some variables. Some pointers may be invalid and cause the dump to abort... thd->query at 0x9832058 = SELECT MIN( table1 . `col_int_key` ) AS field1 FROM ( CC AS table1 RIGHT JOIN C AS table2 ON (table2 . `col_int_key` = table1 . `col_int_nokey` ) ) WHERE ( ( 'k', 'c' ) IN ( SELECT 'e' , 'l' UNION SELECT 'j' , 't' ) ) OR ( table1 . `col_int_key` = table1 . `col_int_key` AND table1 . `pk` = 232 ) OR ( table1 . `col_varchar_key` IN ( SELECT SUBQUERY2_t2 . `col_varchar_key` AS SUBQUERY2_field1 FROM ( B AS SUBQUERY2_t1 LEFT JOIN B AS SUBQUERY2_t2 ON (SUBQUERY2_t2 . `pk` = SUBQUERY2_t1 . `col_int_key` ) ) WHERE SUBQUERY2_t1 . `col_varchar_key` <> table1 . `col_varchar_key` AND SUBQUERY2_t1 . `col_varchar_key` < table2 . `col_varchar_key` ) OR table1 . `col_int_key` >= table2 . `col_int_key` ) HAVING ( 7, 7 ) IN ( SELECT DISTINCT SQL_SMALL_RESULT SUBQUERY3_t1 . `col_int_nokey` AS SUBQUERY3_field1 , SUBQUERY3_t1 . `col_int_nokey` AS SUBQUERY3_field2 FROM C AS SUBQUERY3_t1 WHERE SUBQUERY3_t1 . `col_varchar_key` < 'y' ) ORDER BY table1 . `col_datetime_key` , field1 LIMIT 2 thd->thread_id=2 thd->killed=NOT_KILLED The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains information that should help you find out what is causing the crash. Writing a core file - saving '/mysql-5.1/mysql-test/var/log/main.exp1/' to '/mysql-5.1/mysql-test/var/log/main.exp1/' - found 'core' (0/5) Trying 'dbx' to get a backtrace Trying 'gdb' to get a backtrace Core generated by '/mysql-5.1/sql/mysqld' Output from gdb follows. The first stack trace is from the failing thread. The following stack traces are from all threads (so the failing one is duplicated). -------------------------- [New Thread 29184] [New Thread 29163] warning: Can't read pathname for load map: Input/output error. Core was generated by `/mysql-5.1/sql/mysqld --defaults-group-suffix=.1'. Program terminated with signal 11, Segmentation fault. #0 0x00d16422 in __kernel_vsyscall () #0 0x00d16422 in __kernel_vsyscall () #1 0x008b0e93 in __pthread_kill (threadid=3070016368, signo=11) at ../nptl/sysdeps/unix/sysv/linux/pthread_kill.c:64 #2 0x08cbd8a6 in my_write_core (sig=11) at stacktrace.c:329 #3 0x083cfad2 in handle_segfault (sig=11) at mysqld.cc:2570 #4 #5 0x0851bd87 in copy_fields (param=0x9872980) at sql_select.cc:15355 #6 0x0850c4d6 in end_write (join=0x9871920, join_tab=0x987142c, end_of_records=false) at sql_select.cc:12413 #7 0x08506d27 in evaluate_join_record (join=0x9871920, join_tab=0x9871298, error=0) at sql_select.cc:11437 #8 0x085065da in sub_select (join=0x9871920, join_tab=0x9871298, end_of_records=false) at sql_select.cc:11317 #9 0x08505a33 in do_select (join=0x9871920, fields=0x0, table=0x984ba08, procedure=0x0) at sql_select.cc:11067 #10 0x084d8475 in JOIN::exec (this=0x986dfc8) at sql_select.cc:1908 #11 0x0833453a in subselect_single_select_engine::exec (this=0x98434e8) at item_subselect.cc:1972 #12 0x08328ad1 in Item_subselect::exec (this=0x9843438) at item_subselect.cc:265 #13 0x0832cb80 in Item_in_subselect::val_bool (this=0x9843438) at item_subselect.cc:865 #14 0x0823e536 in Item::val_bool_result (this=0x9843438) at item.h:745 #15 0x082a4086 in Item_in_optimizer::val_int (this=0x986f240) at item_cmpfunc.cc:1833 #16 0x0850b980 in end_send_group (join=0x9847a38, join_tab=0x9877444, end_of_records=true) at sql_select.cc:12329 #17 0x085063c3 in sub_select (join=0x9847a38, join_tab=0x98772b0, end_of_records=true) at sql_select.cc:11276 #18 0x08505a99 in do_select (join=0x9847a38, fields=0x9848ba0, table=0x0, procedure=0x0) at sql_select.cc:11069 #19 0x084db4a6 in JOIN::exec (this=0x9847a38) at sql_select.cc:2315 #20 0x084dc3dd in mysql_select (thd=0x97e07d8, rref_pointer_array=0x97e1c78, tables=0x9832c70, wild_num=0, fields=..., conds=0x98427c0, og_num=2, order=0x98435f8, group=0x0, having=0x9843438, proc_param=0x0, select_options=2147764736, result=0x9843770, unit=0x97e1910, select_lex=0x97e1b80) at sql_select.cc:2510 #21 0x084cd9c5 in handle_select (thd=0x97e07d8, lex=0x97e18b4, result=0x9843770, setup_tables_done_option=0) at sql_select.cc:269 #22 0x08408425 in execute_sqlcom_select (thd=0x97e07d8, all_tables=0x9832c70) at sql_parse.cc:5052 #23 0x083f5598 in mysql_execute_command (thd=0x97e07d8) at sql_parse.cc:2248 #24 0x0840cb28 in mysql_parse (thd=0x97e07d8, inBuf=0x9832058 "SELECT MIN( table1 . `col_int_key` ) AS field1 \nFROM ( CC AS table1 RIGHT JOIN C AS table2 ON (table2 . `col_int_key` = table1 . `col_int_nokey` ) ) \nWHERE ( ( 'k', 'c' ) IN ( \nSELECT 'e' , 'l"..., length=1012, found_semicolon=0xb6fcb058) at sql_parse.cc:5971 #25 0x083f09d8 in dispatch_command (command=COM_QUERY, thd=0x97e07d8, packet=0x9826111 "", packet_length=1013) at sql_parse.cc:1233 #26 0x083eec2f in do_command (thd=0x97e07d8) at sql_parse.cc:874 #27 0x083eb29b in handle_one_connection (arg=0x97e07d8) at sql_connect.cc:1127 #28 0x008ab80e in start_thread (arg=0xb6fcbb70) at pthread_create.c:300 #29 0x0028c8de in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:130 Thread 3 (Thread 29163): #0 0x00d16422 in __kernel_vsyscall () #1 0x00285a71 in select () from /lib/tls/i686/cmov/libc.so.6 #2 0x083d90f5 in handle_connections_sockets (arg=0x0) at mysqld.cc:5054 #3 0x083d76bf in main (argc=8, argv=0xbf870084) at mysqld.cc:4538 Thread 2 (Thread 29184): #0 0x00d16422 in __kernel_vsyscall () #1 0x008b3d5a in do_sigwait (set=0x8bbff4, sig=) at ../nptl/sysdeps/unix/sysv/linux/../../../../../sysdeps/unix/sysv/linux/sigwait.c:63 #2 0x008b3e00 in __sigwait (set=0xb6ffc2f0, sig=0xb6ffc388) at ../nptl/sysdeps/unix/sysv/linux/../../../../../sysdeps/unix/sysv/linux/sigwait.c:100 #3 0x083d0e74 in signal_hand (arg=0x0) at mysqld.cc:2772 #4 0x008ab80e in start_thread (arg=0xb6ffcb70) at pthread_create.c:300 #5 0x0028c8de in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:130 Thread 1 (Thread 29203): #0 0x00d16422 in __kernel_vsyscall () #1 0x008b0e93 in __pthread_kill (threadid=3070016368, signo=11) at ../nptl/sysdeps/unix/sysv/linux/pthread_kill.c:64 #2 0x08cbd8a6 in my_write_core (sig=11) at stacktrace.c:329 #3 0x083cfad2 in handle_segfault (sig=11) at mysqld.cc:2570 #4 #5 0x0851bd87 in copy_fields (param=0x9872980) at sql_select.cc:15355 #6 0x0850c4d6 in end_write (join=0x9871920, join_tab=0x987142c, end_of_records=false) at sql_select.cc:12413 #7 0x08506d27 in evaluate_join_record (join=0x9871920, join_tab=0x9871298, error=0) at sql_select.cc:11437 #8 0x085065da in sub_select (join=0x9871920, join_tab=0x9871298, end_of_records=false) at sql_select.cc:11317 #9 0x08505a33 in do_select (join=0x9871920, fields=0x0, table=0x984ba08, procedure=0x0) at sql_select.cc:11067 #10 0x084d8475 in JOIN::exec (this=0x986dfc8) at sql_select.cc:1908 #11 0x0833453a in subselect_single_select_engine::exec (this=0x98434e8) at item_subselect.cc:1972 #12 0x08328ad1 in Item_subselect::exec (this=0x9843438) at item_subselect.cc:265 #13 0x0832cb80 in Item_in_subselect::val_bool (this=0x9843438) at item_subselect.cc:865 #14 0x0823e536 in Item::val_bool_result (this=0x9843438) at item.h:745 #15 0x082a4086 in Item_in_optimizer::val_int (this=0x986f240) at item_cmpfunc.cc:1833 #16 0x0850b980 in end_send_group (join=0x9847a38, join_tab=0x9877444, end_of_records=true) at sql_select.cc:12329 #17 0x085063c3 in sub_select (join=0x9847a38, join_tab=0x98772b0, end_of_records=true) at sql_select.cc:11276 #18 0x08505a99 in do_select (join=0x9847a38, fields=0x9848ba0, table=0x0, procedure=0x0) at sql_select.cc:11069 #19 0x084db4a6 in JOIN::exec (this=0x9847a38) at sql_select.cc:2315 #20 0x084dc3dd in mysql_select (thd=0x97e07d8, rref_pointer_array=0x97e1c78, tables=0x9832c70, wild_num=0, fields=..., conds=0x98427c0, og_num=2, order=0x98435f8, group=0x0, having=0x9843438, proc_param=0x0, select_options=2147764736, result=0x9843770, unit=0x97e1910, select_lex=0x97e1b80) at sql_select.cc:2510 #21 0x084cd9c5 in handle_select (thd=0x97e07d8, lex=0x97e18b4, result=0x9843770, setup_tables_done_option=0) at sql_select.cc:269 #22 0x08408425 in execute_sqlcom_select (thd=0x97e07d8, all_tables=0x9832c70) at sql_parse.cc:5052 #23 0x083f5598 in mysql_execute_command (thd=0x97e07d8) at sql_parse.cc:2248 #24 0x0840cb28 in mysql_parse (thd=0x97e07d8, inBuf=0x9832058 "SELECT MIN( table1 . `col_int_key` ) AS field1 \nFROM ( CC AS table1 RIGHT JOIN C AS table2 ON (table2 . `col_int_key` = table1 . `col_int_nokey` ) ) \nWHERE ( ( 'k', 'c' ) IN ( \nSELECT 'e' , 'l"..., length=1012, found_semicolon=0xb6fcb058) at sql_parse.cc:5971 #25 0x083f09d8 in dispatch_command (command=COM_QUERY, thd=0x97e07d8, packet=0x9826111 "", packet_length=1013) at sql_parse.cc:1233 #26 0x083eec2f in do_command (thd=0x97e07d8) at sql_parse.cc:874 #27 0x083eb29b in handle_one_connection (arg=0x97e07d8) at sql_connect.cc:1127 #28 0x008ab80e in start_thread (arg=0xb6fcbb70) at pthread_create.c:300 #29 0x0028c8de in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:130