Server [mysqld.1 - pid: 5572, winpid: 5572, exit: 256] failed during test run Server log from this test: 091222 8:13:32 [Note] Plugin 'FEDERATED' is disabled. 091222 8:13:32 [Note] Plugin 'ndbcluster' is disabled. InnoDB: The InnoDB memory heap has been disabled. InnoDB: ios_per_array 256 read threads 2 write threads 2 InnoDB: The first specified data file ./ibdata1 did not exist: InnoDB: a new database to be created! 091222 8:13:32 InnoDB: Setting file ./ibdata1 size to 10 MB InnoDB: Database physically writes the file full: wait... 091222 8:13:32 InnoDB: Log file ./ib_logfile0 did not exist: new to be created InnoDB: Setting log file ./ib_logfile0 size to 5 MB InnoDB: Database physically writes the file full: wait... 091222 8:13:32 InnoDB: Log file ./ib_logfile1 did not exist: new to be created InnoDB: Setting log file ./ib_logfile1 size to 5 MB InnoDB: Database physically writes the file full: wait... InnoDB: Doublewrite buffer not found: creating new InnoDB: Doublewrite buffer created InnoDB: Creating foreign key constraint system tables InnoDB: Foreign key constraint system tables created 091222 8:13:33 InnoDB: Started; log sequence number 0 0 InnoDB master thread running with io_capacity 200 091222 8:13:33 [Note] Event Scheduler: Loaded 0 events 091222 8:13:33 [Note]/mysql-6.0/sql/mysqld: ready for connections. Version: '6.0.14-alpha-gcov-debug-log' socket: '/home/pcrews/bzr/work/range_122109/mysql-6.0/mysql-test/var/tmp/mysqld.1.sock' port: 13000 Source distribution mysqld: opt_range.h:522: virtual void QUICK_ROR_INTERSECT_SELECT::need_sorted_output(): Assertion `0' failed. 091222 8:13:33 - mysqld got signal 6 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. key_buffer_size=1048576 read_buffer_size=131072 max_used_connections=1 max_threads=151 thread_count=1 connection_count=1 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 60109 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. thd: 0xa451550 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0xb1e79f7c thread_stack 0x30c00 /home/pcrews/bzr/work/range_122109/mysql-6.0/sql/mysqld(my_print_stacktrace+0x42) [0x8cafbae] /home/pcrews/bzr/work/range_122109/mysql-6.0/sql/mysqld(handle_segfault+0x4e3) [0x840546d] [0xb9e400] /lib/tls/i686/cmov/libc.so.6(abort+0x182) [0x641932] /lib/tls/i686/cmov/libc.so.6(__assert_fail+0xf8) [0x637648] /home/pcrews/bzr/work/range_122109/mysql-6.0/sql/mysqld(QUICK_ROR_INTERSECT_SELECT::reverse_sorted()+0) [0x86a48de] /home/pcrews/bzr/work/range_122109/mysql-6.0/sql/mysqld [0x8567cb5] /home/pcrews/bzr/work/range_122109/mysql-6.0/sql/mysqld(JOIN::exec()+0xec3) [0x851b80b] /home/pcrews/bzr/work/range_122109/mysql-6.0/sql/mysqld(mysql_select(THD*, Item***, TABLE_LIST*, unsigned int, List&, Item*, unsigned int, st_order*, st_order*, Item*, st_order*, unsigned long long, select_result*, st_select_lex_unit*, st_select_lex*)+0x5aa) [0x851f61e] /home/pcrews/bzr/work/range_122109/mysql-6.0/sql/mysqld(mysql_explain_union(THD*, st_select_lex_unit*, select_result*)+0x5d9) [0x857803e] /home/pcrews/bzr/work/range_122109/mysql-6.0/sql/mysqld [0x843c393] /home/pcrews/bzr/work/range_122109/mysql-6.0/sql/mysqld(mysql_execute_command(THD*)+0x1427) [0x842ab6a] /home/pcrews/bzr/work/range_122109/mysql-6.0/sql/mysqld(mysql_parse(THD*, char const*, unsigned int, char const**)+0x545) [0x8440a07] /home/pcrews/bzr/work/range_122109/mysql-6.0/sql/mysqld(dispatch_command(enum_server_command, THD*, char*, unsigned int)+0x12bf) [0x8425ddf] /home/pcrews/bzr/work/range_122109/mysql-6.0/sql/mysqld(do_command(THD*)+0x492) [0x842462f] /home/pcrews/bzr/work/range_122109/mysql-6.0/sql/mysqld(handle_one_connection+0x300) [0x842181a] /lib/tls/i686/cmov/libpthread.so.0 [0x18b80e] /lib/tls/i686/cmov/libc.so.6(clone+0x5e) [0x6e07ee] Trying to get some variables. Some pointers may be invalid and cause the dump to abort... thd->query at 0xa41a338 = EXPLAIN SELECT table2 .`pk` field1 FROM C table1 LEFT JOIN L table2 ON table1 .`col_int_key` = table2 .`col_int_key` WHERE table2 .`col_varchar_10_latin1_key` IN ( 'e' ) AND table2 .`pk` IS NULL ORDER BY field1 thd->thread_id=2 thd->killed=NOT_KILLED The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains information that should help you find out what is causing the crash. Writing a core file - saving '/home/pcrews/bzr/work/range_122109/mysql-6.0/mysql-test/var/log/main.exp1/' to '/home/pcrews/bzr/work/range_122109/mysql-6.0/mysql-test/var/log/main.exp1/' - found 'core' (0/5) Trying 'dbx' to get a backtrace Trying 'gdb' to get a backtrace Core generated by '/home/pcrews/bzr/work/range_122109/mysql-6.0/sql/mysqld' Output from gdb follows. The first stack trace is from the failing thread. The following stack traces are from all threads (so the failing one is duplicated). -------------------------- [New Thread 5576] [New Thread 5579] [New Thread 5581] [New Thread 5577] [New Thread 5582] [New Thread 5583] [New Thread 5584] [New Thread 5573] [New Thread 5575] [New Thread 5578] [New Thread 5580] warning: Can't read pathname for load map: Input/output error. Core was generated by `/home/pcrews/bzr/work/range_122109/mysql-6.0/sql/mysqld --defaults-group-suffix'. Program terminated with signal 6, Aborted. #0 0x00b9e422 in __kernel_vsyscall () #0 0x00b9e422 in __kernel_vsyscall () #1 0x00190e93 in __pthread_kill (threadid=2984748912, signo=6) at ../nptl/sysdeps/unix/sysv/linux/pthread_kill.c:64 #2 0x08cafdc7 in my_write_core (sig=6) at stacktrace.c:328 #3 0x08405982 in handle_segfault (sig=6) at mysqld.cc:2771 #4 #5 0x00b9e422 in __kernel_vsyscall () #6 0x0063e4d1 in *__GI_raise (sig=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64 #7 0x00641932 in *__GI_abort () at abort.c:92 #8 0x00637648 in *__GI___assert_fail (assertion=0x8fea0a1 "0", file=0x8fea095 "opt_range.h", line=522, function=0x8feb580 "virtual void QUICK_ROR_INTERSECT_SELECT::need_sorted_output()") at assert.c:81 #9 0x086a48de in QUICK_ROR_INTERSECT_SELECT::need_sorted_output (this=0xa41d9d8) at opt_range.h:522 #10 0x08567cb5 in test_if_skip_sort_order (tab=0xa52f0dc, order=0xa41bb30, select_limit=18446744073709551615, no_changes=false, map=0xa41cef8) at sql_select.cc:19258 #11 0x0851b80b in JOIN::exec (this=0xa529518) at sql_select.cc:2484 #12 0x0851f61e in mysql_select (thd=0xa451550, rref_pointer_array=0xa452ab8, tables=0xa41a640, wild_num=0, fields=..., conds=0xa41b9d8, og_num=1, order=0xa41bb30, group=0x0, having=0x0, proc_param=0x0, select_options=2147748356, result=0xa41bbc8, unit=0xa4524fc, select_lex=0xa4529b4) at sql_select.cc:3145 #13 0x0857803e in mysql_explain_union (thd=0xa451550, unit=0xa4524fc, result=0xa41bbc8) at sql_select.cc:22235 #14 0x0843c393 in execute_sqlcom_select (thd=0xa451550, all_tables=0xa41a640) at sql_parse.cc:4932 #15 0x0842ab6a in mysql_execute_command (thd=0xa451550) at sql_parse.cc:2148 #16 0x08440a07 in mysql_parse (thd=0xa451550, inBuf=0xa41a338 "EXPLAIN SELECT table2 .`pk` field1 \nFROM C table1 LEFT JOIN L table2 ON table1 .`col_int_key` = table2 .`col_int_key` \nWHERE table2 .`col_varchar_10_latin1_key` IN ( 'e' ) AND table2 .`pk` IS"..., length=225, found_semicolon=0xb1e7998c) at sql_parse.cc:5968 #17 0x08425ddf in dispatch_command (command=COM_QUERY, thd=0xa451550, packet=0xa4202b1 "", packet_length=228) at sql_parse.cc:1073 #18 0x0842462f in do_command (thd=0xa451550) at sql_parse.cc:757 #19 0x0842181a in handle_one_connection (arg=0xa451550) at sql_connect.cc:1164 #20 0x0018b80e in start_thread (arg=0xb1e7a770) at pthread_create.c:300 #21 0x006e07ee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:130 Thread 12 (Thread 5580): #0 0x00b9e422 in __kernel_vsyscall () #1 0x0018fe15 in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_wait.S:122 #2 0x08cfab76 in safe_cond_wait (cond=0xa285edc, mp=0xa285e70, file=0x90548f6 "os/os0sync.c", line=422) at thr_mutex.c:426 #3 0x08a1850f in os_event_wait_low (event=0xa285e70, reset_sig_count=0) at os/os0sync.c:422 #4 0x08a161df in os_aio_simulated_handle (global_segment=5, message1=0xb4378344, message2=0xb4378340, type=0xb437833c) at os/os0file.c:4252 #5 0x089c60b6 in fil_aio_wait (segment=5) at fil/fil0fil.c:4246 #6 0x08a6e6ec in io_handler_thread (arg=0x9399814) at srv/srv0start.c:435 #7 0x0018b80e in start_thread (arg=0xb4378b70) at pthread_create.c:300 #8 0x006e07ee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:130 Thread 11 (Thread 5578): #0 0x00b9e422 in __kernel_vsyscall () #1 0x0018fe15 in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_wait.S:122 #2 0x08cfab76 in safe_cond_wait (cond=0xa285d6c, mp=0xa285d00, file=0x90548f6 "os/os0sync.c", line=422) at thr_mutex.c:426 #3 0x08a1850f in os_event_wait_low (event=0xa285d00, reset_sig_count=0) at os/os0sync.c:422 #4 0x08a161df in os_aio_simulated_handle (global_segment=3, message1=0xb537a344, message2=0xb537a340, type=0xb537a33c) at os/os0file.c:4252 #5 0x089c60b6 in fil_aio_wait (segment=3) at fil/fil0fil.c:4246 #6 0x08a6e6ec in io_handler_thread (arg=0x939980c) at srv/srv0start.c:435 #7 0x0018b80e in start_thread (arg=0xb537ab70) at pthread_create.c:300 #8 0x006e07ee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:130 Thread 10 (Thread 5575): #0 0x00b9e422 in __kernel_vsyscall () #1 0x0018fe15 in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_wait.S:122 #2 0x08cfab76 in safe_cond_wait (cond=0xa285b44, mp=0xa285ad8, file=0x90548f6 "os/os0sync.c", line=422) at thr_mutex.c:426 #3 0x08a1850f in os_event_wait_low (event=0xa285ad8, reset_sig_count=0) at os/os0sync.c:422 #4 0x08a161df in os_aio_simulated_handle (global_segment=0, message1=0xb7805344, message2=0xb7805340, type=0xb780533c) at os/os0file.c:4252 #5 0x089c60b6 in fil_aio_wait (segment=0) at fil/fil0fil.c:4246 #6 0x08a6e6ec in io_handler_thread (arg=0x9399800) at srv/srv0start.c:435 #7 0x0018b80e in start_thread (arg=0xb7805b70) at pthread_create.c:300 #8 0x006e07ee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:130 Thread 9 (Thread 5573): #0 0x00b9e422 in __kernel_vsyscall () #1 0x006d9981 in select () from /lib/tls/i686/cmov/libc.so.6 #2 0x0840eed5 in handle_connections_sockets () at mysqld.cc:5394 #3 0x0840d815 in main (argc=9, argv=0xbfa55cc4) at mysqld.cc:4887 Thread 8 (Thread 5584): #0 0x00b9e422 in __kernel_vsyscall () #1 0x00193d5a in do_sigwait (set=0x19bff4, sig=) at ../nptl/sysdeps/unix/sysv/linux/../../../../../sysdeps/unix/sysv/linux/sigwait.c:63 #2 0x00193e00 in __sigwait (set=0xb1eaaee4, sig=0xb1eaaf7c) at ../nptl/sysdeps/unix/sysv/linux/../../../../../sysdeps/unix/sysv/linux/sigwait.c:100 #3 0x08406aea in signal_hand (arg=0x0) at mysqld.cc:2973 #4 0x0018b80e in start_thread (arg=0xb1eab770) at pthread_create.c:300 #5 0x006e07ee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:130 Thread 7 (Thread 5583): #0 0x00b9e422 in __kernel_vsyscall () #1 0x006d9981 in select () from /lib/tls/i686/cmov/libc.so.6 #2 0x08a19589 in os_thread_sleep (tm=1000000) at os/os0thread.c:268 #3 0x08a6c4a1 in srv_master_thread (arg=0x0) at srv/srv0srv.c:2450 #4 0x0018b80e in start_thread (arg=0xb26acb70) at pthread_create.c:300 #5 0x006e07ee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:130 Thread 6 (Thread 5582): #0 0x00b9e422 in __kernel_vsyscall () #1 0x006d9981 in select () from /lib/tls/i686/cmov/libc.so.6 #2 0x08a19589 in os_thread_sleep (tm=1000000) at os/os0thread.c:268 #3 0x08a6bfb3 in srv_error_monitor_thread (arg=0x0) at srv/srv0srv.c:2307 #4 0x0018b80e in start_thread (arg=0xb3375b70) at pthread_create.c:300 #5 0x006e07ee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:130 Thread 5 (Thread 5577): #0 0x00b9e422 in __kernel_vsyscall () #1 0x0018fe15 in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_wait.S:122 #2 0x08cfab76 in safe_cond_wait (cond=0xa285cb4, mp=0xa285c48, file=0x90548f6 "os/os0sync.c", line=422) at thr_mutex.c:426 #3 0x08a1850f in os_event_wait_low (event=0xa285c48, reset_sig_count=0) at os/os0sync.c:422 #4 0x08a161df in os_aio_simulated_handle (global_segment=2, message1=0xb5b7b344, message2=0xb5b7b340, type=0xb5b7b33c) at os/os0file.c:4252 #5 0x089c60b6 in fil_aio_wait (segment=2) at fil/fil0fil.c:4246 #6 0x08a6e6ec in io_handler_thread (arg=0x9399808) at srv/srv0start.c:435 #7 0x0018b80e in start_thread (arg=0xb5b7bb70) at pthread_create.c:300 #8 0x006e07ee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:130 Thread 4 (Thread 5581): #0 0x00b9e422 in __kernel_vsyscall () #1 0x006d9981 in select () from /lib/tls/i686/cmov/libc.so.6 #2 0x08a19589 in os_thread_sleep (tm=1000000) at os/os0thread.c:268 #3 0x08a6b37d in srv_lock_timeout_and_monitor_thread (arg=0x0) at srv/srv0srv.c:2104 #4 0x0018b80e in start_thread (arg=0xb3b76b70) at pthread_create.c:300 #5 0x006e07ee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:130 Thread 3 (Thread 5579): #0 0x00b9e422 in __kernel_vsyscall () #1 0x0018fe15 in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_wait.S:122 #2 0x08cfab76 in safe_cond_wait (cond=0xa285e24, mp=0xa285db8, file=0x90548f6 "os/os0sync.c", line=422) at thr_mutex.c:426 #3 0x08a1850f in os_event_wait_low (event=0xa285db8, reset_sig_count=0) at os/os0sync.c:422 #4 0x08a161df in os_aio_simulated_handle (global_segment=4, message1=0xb4b79344, message2=0xb4b79340, type=0xb4b7933c) at os/os0file.c:4252 #5 0x089c60b6 in fil_aio_wait (segment=4) at fil/fil0fil.c:4246 #6 0x08a6e6ec in io_handler_thread (arg=0x9399810) at srv/srv0start.c:435 #7 0x0018b80e in start_thread (arg=0xb4b79b70) at pthread_create.c:300 #8 0x006e07ee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:130 Thread 2 (Thread 5576): #0 0x00b9e422 in __kernel_vsyscall () #1 0x0018fe15 in pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/i386/i686/../i486/pthread_cond_wait.S:122 #2 0x08cfab76 in safe_cond_wait (cond=0xa285bfc, mp=0xa285b90, file=0x90548f6 "os/os0sync.c", line=422) at thr_mutex.c:426 #3 0x08a1850f in os_event_wait_low (event=0xa285b90, reset_sig_count=0) at os/os0sync.c:422 #4 0x08a161df in os_aio_simulated_handle (global_segment=1, message1=0xb637c344, message2=0xb637c340, type=0xb637c33c) at os/os0file.c:4252 #5 0x089c60b6 in fil_aio_wait (segment=1) at fil/fil0fil.c:4246 #6 0x08a6e6ec in io_handler_thread (arg=0x9399804) at srv/srv0start.c:435 #7 0x0018b80e in start_thread (arg=0xb637cb70) at pthread_create.c:300 #8 0x006e07ee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:130 Thread 1 (Thread 5594): #0 0x00b9e422 in __kernel_vsyscall () #1 0x00190e93 in __pthread_kill (threadid=2984748912, signo=6) at ../nptl/sysdeps/unix/sysv/linux/pthread_kill.c:64 #2 0x08cafdc7 in my_write_core (sig=6) at stacktrace.c:328 #3 0x08405982 in handle_segfault (sig=6) at mysqld.cc:2771 #4 #5 0x00b9e422 in __kernel_vsyscall () #6 0x0063e4d1 in *__GI_raise (sig=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64 #7 0x00641932 in *__GI_abort () at abort.c:92 #8 0x00637648 in *__GI___assert_fail (assertion=0x8fea0a1 "0", file=0x8fea095 "opt_range.h", line=522, function=0x8feb580 "virtual void QUICK_ROR_INTERSECT_SELECT::need_sorted_output()") at assert.c:81 #9 0x086a48de in QUICK_ROR_INTERSECT_SELECT::need_sorted_output (this=0xa41d9d8) at opt_range.h:522 #10 0x08567cb5 in test_if_skip_sort_order (tab=0xa52f0dc, order=0xa41bb30, select_limit=18446744073709551615, no_changes=false, map=0xa41cef8) at sql_select.cc:19258 #11 0x0851b80b in JOIN::exec (this=0xa529518) at sql_select.cc:2484 #12 0x0851f61e in mysql_select (thd=0xa451550, rref_pointer_array=0xa452ab8, tables=0xa41a640, wild_num=0, fields=..., conds=0xa41b9d8, og_num=1, order=0xa41bb30, group=0x0, having=0x0, proc_param=0x0, select_options=2147748356, result=0xa41bbc8, unit=0xa4524fc, select_lex=0xa4529b4) at sql_select.cc:3145 #13 0x0857803e in mysql_explain_union (thd=0xa451550, unit=0xa4524fc, result=0xa41bbc8) at sql_select.cc:22235 #14 0x0843c393 in execute_sqlcom_select (thd=0xa451550, all_tables=0xa41a640) at sql_parse.cc:4932 #15 0x0842ab6a in mysql_execute_command (thd=0xa451550) at sql_parse.cc:2148 #16 0x08440a07 in mysql_parse (thd=0xa451550, inBuf=0xa41a338 "EXPLAIN SELECT table2 .`pk` field1 \nFROM C table1 LEFT JOIN L table2 ON table1 .`col_int_key` = table2 .`col_int_key` \nWHERE table2 .`col_varchar_10_latin1_key` IN ( 'e' ) AND table2 .`pk` IS"..., length=225, found_semicolon=0xb1e7998c) at sql_parse.cc:5968 #17 0x08425ddf in dispatch_command (command=COM_QUERY, thd=0xa451550, packet=0xa4202b1 "", packet_length=228) at sql_parse.cc:1073 #18 0x0842462f in do_command (thd=0xa451550) at sql_parse.cc:757 #19 0x0842181a in handle_one_connection (arg=0xa451550) at sql_connect.cc:1164 #20 0x0018b80e in start_thread (arg=0xb1e7a770) at pthread_create.c:300 #21 0x006e07ee in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:130