101011 16:36:08 mysqld_safe mysqld restarted 101011 16:36:08 [Note] Plugin 'FEDERATED' is disabled. InnoDB: The InnoDB memory heap is disabled InnoDB: Mutexes and rw_locks use GCC atomic builtins InnoDB: Compressed tables use zlib 1.2.3 101011 16:36:09 InnoDB: highest supported file format is Barracuda. InnoDB: The log sequence number in ibdata files does not match InnoDB: the log sequence number in the ib_logfiles! 101011 16:36:10 InnoDB: Database was not shut down normally! InnoDB: Starting crash recovery. InnoDB: Reading tablespace information from the .ibd files... InnoDB: Restoring possible half-written data pages from the doublewrite InnoDB: buffer... InnoDB: Last MySQL binlog file position 0 387, file name /var/lib/mysql/zabbixdb-bin.000228 101011 16:36:11 InnoDB Plugin 1.0.12 started; log sequence number 882307352380 101011 16:36:11 [Note] Recovering after a crash using /var/lib/mysql/zabbixdb-bin 101011 16:36:11 [Note] Starting crash recovery... 101011 16:36:11 [Note] Crash recovery finished. 101011 16:36:11 [Note] Event Scheduler: Loaded 0 events 101011 16:36:11 [Note] /usr/sbin/mysqld: ready for connections. Version: '5.1.51-community-log' socket: '/var/lib/mysql/mysql.sock' port: 3306 MySQL Community Server (GPL) InnoDB: Error: trying to access update undo rec for table zabbix/hosts InnoDB: but the table id in the undo record is wrong InnoDB: Submit a detailed bug report to http://bugs.mysql.com InnoDB: Run also CHECK TABLE zabbix/hosts InnoDB: table zabbix/hosts, index PRIMARY, n_uniq 1 InnoDB: undo rec address 0x34afbe88, type 0 cmpl_info 0 InnoDB: undo rec table id 0 13424, index table id 0 136 InnoDB: dump of 150 bytes in undo rec: len 150; hex 7f00005cb470c7e0800000002d340206000060f1ee3e001a0308000000000000d8910404cc3be4c20006000060f1ee3e2f422fae0e017f00005cb470c7e080000000390a1006000060f1fc6a001a0308000000000000d8910404cc3be5750006000060f1fc6a2f782fe40e027f00005cb470c7e0800000003d1e6506000060f20a7f001a0308000000000000d8910404cc3be62a0006; asc \ p -4 ` > ; ` >/B/ \ p 9 ` j ; u ` j/x/ \ p = e ` ; * ; InnoDB: index record PHYSICAL RECORD: n_fields 36; compact format; info bits 0 0: len 8; hex 0000000000002745; asc 'E;; 1: len 6; hex 00006390f896; asc c ;; 2: len 7; hex 0000001d132f46; asc /F;; 3: len 8; hex 0000000000000000; asc ;; 4: len 3; hex 575448; asc WTH;; 5: len 0; hex ; asc ;; 6: len 4; hex 80000001; asc ;; 7: len 9; hex 3132372e302e302e31; asc 127.0.0.1;; 8: len 4; hex 80002742; asc 'B;; 9: len 4; hex 80000005; asc ;; 10: len 4; hex 80000000; asc ;; 11: len 0; hex ; asc ;; 12: len 4; hex 80000000; asc ;; 13: len 4; hex 80000000; asc ;; 14: len 4; hex ccb363aa; asc c ;; 15: len 8; hex 0000000000000000; asc ;; 16: len 8; hex 0000000000000000; asc ;; 17: len 4; hex 80000000; asc ;; 18: len 4; hex 8000026f; asc o;; 19: len 4; hex 80000000; asc ;; 20: len 4; hex 80000002; asc ;; 21: len 0; hex ; asc ;; 22: len 0; hex ; asc ;; 23: len 4; hex 80000000; asc ;; 24: len 4; hex 80000000; asc ;; 25: len 4; hex 80000000; asc ;; 26: len 4; hex 80000000; asc ;; 27: len 8; hex 0000000000000000; asc ;; 28: len 4; hex 80000000; asc ;; 29: len 4; hex 80000000; asc ;; 30: len 4; hex 80000000; asc ;; 31: len 9; hex 3132372e302e302e31; asc 127.0.0.1;; 32: len 4; hex 80000000; asc ;; 33: len 4; hex 80000000; asc ;; 34: len 0; hex ; asc ;; 35: len 0; hex ; asc ;; InnoDB: record version PHYSICAL RECORD: n_fields 36; compact format; info bits 0 0: len 8; hex 0000000000002745; asc 'E;; 1: len 6; hex 00006390f896; asc c ;; 2: len 7; hex 0000001d132f46; asc /F;; 3: len 8; hex 0000000000000000; asc ;; 4: len 3; hex 575448; asc WTH;; 5: len 0; hex ; asc ;; 6: len 4; hex 80000001; asc ;; 7: len 9; hex 3132372e302e302e31; asc 127.0.0.1;; 8: len 4; hex 80002742; asc 'B;; 9: len 4; hex 80000005; asc ;; 10: len 4; hex 80000000; asc ;; 11: len 0; hex ; asc ;; 12: len 4; hex 80000000; asc ;; 13: len 4; hex 80000000; asc ;; 14: len 4; hex ccb363aa; asc c ;; 15: len 8; hex 0000000000000000; asc ;; 16: len 8; hex 0000000000000000; asc ;; 17: len 4; hex 80000000; asc ;; 18: len 4; hex 8000026f; asc o;; 19: len 4; hex 80000000; asc ;; 20: len 4; hex 80000002; asc ;; 21: len 0; hex ; asc ;; 22: len 0; hex ; asc ;; 23: len 4; hex 80000000; asc ;; 24: len 4; hex 80000000; asc ;; 25: len 4; hex 80000000; asc ;; 26: len 4; hex 80000000; asc ;; 27: len 8; hex 0000000000000000; asc ;; 28: len 4; hex 80000000; asc ;; 29: len 4; hex 80000000; asc ;; 30: len 4; hex 80000000; asc ;; 31: len 9; hex 3132372e302e302e31; asc 127.0.0.1;; 32: len 4; hex 80000000; asc ;; 33: len 4; hex 80000000; asc ;; 34: len 0; hex ; asc ;; 35: len 0; hex ; asc ;; InnoDB: Record trx id 6390F896, update rec trx id 800000002D3402 InnoDB: Roll ptr in rec 0 487796550, in update rec 6 24817 InnoDB: Purge system view: Normal read view Read view low limit trx n:o 0 1670217728 Read view up limit trx id 638D8000 Read view low limit trx id 638D8000 Read view individually stored trx ids: InnoDB: Purge trx n:o 638D7C06, undo n:o 0 InnoDB: Purge next stored 0, page_no 45, offset 0, InnoDB: Purge hdr_page_no 45, hdr_offset 86 InnoDB: unknown error code 11 101011 16:36:19 InnoDB: Assertion failure in thread 1092278592 in file row/row0mysql.c line 589 InnoDB: We intentionally generate a memory trap. InnoDB: Submit a detailed bug report to http://bugs.mysql.com. InnoDB: If you get repeated assertion failures or crashes, even InnoDB: immediately after the mysqld startup, there may be InnoDB: corruption in the InnoDB tablespace. Please refer to InnoDB: http://dev.mysql.com/doc/refman/5.1/en/forcing-recovery.html InnoDB: about forcing recovery. 101011 16:36:19 - mysqld got signal 6 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. key_buffer_size=8384512 read_buffer_size=2097152 max_used_connections=1 max_threads=50 threads_connected=1 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 3387905 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. thd: 0x348d96f0 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x411acf10 thread_stack 0x40000 /usr/sbin/mysqld(my_print_stacktrace+0x2e)[0x854e2e] /usr/sbin/mysqld(handle_segfault+0x322)[0x5c3342] /lib64/libpthread.so.0[0x3283e0eb10] /lib64/libc.so.6(gsignal+0x35)[0x3283230265] /lib64/libc.so.6(abort+0x110)[0x3283231d10] /usr/lib64/mysql/plugin/ha_innodb_plugin.so[0x2aaab382a888] /usr/lib64/mysql/plugin/ha_innodb_plugin.so[0x2aaab38369a5] /usr/lib64/mysql/plugin/ha_innodb_plugin.so[0x2aaab38308c5] /usr/lib64/mysql/plugin/ha_innodb_plugin.so[0x2aaab37dc3f7] /usr/sbin/mysqld(_ZN7handler8ha_checkEP3THDP15st_ha_check_opt+0x4a)[0x69f9ba] /usr/sbin/mysqld[0x6bb15e] /usr/sbin/mysqld(_Z17mysql_check_tableP3THDP10TABLE_LISTP15st_ha_check_opt+0x5c)[0x6bbcfc] /usr/sbin/mysqld(_Z21mysql_execute_commandP3THD+0x216d)[0x5d27cd] /usr/sbin/mysqld(_Z11mysql_parseP3THDPcjPPKc+0x2ae)[0x5d695e] /usr/sbin/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcj+0x585)[0x5d6ef5] /usr/sbin/mysqld(_Z10do_commandP3THD+0xe4)[0x5d8024] /usr/sbin/mysqld(handle_one_connection+0x6f0)[0x5ca510] /lib64/libpthread.so.0[0x3283e0673d] /lib64/libc.so.6(clone+0x6d)[0x32832d3d1d] Trying to get some variables. Some pointers may be invalid and cause the dump to abort... thd->query at 0x3492ebb0 = check table hosts thd->thread_id=1 thd->killed=NOT_KILLED The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains information that should help you find out what is causing the crash. 101011 16:36:20 mysqld_safe Number of processes running now: 0 101011 16:36:20 mysqld_safe mysqld restarted 101011 16:36:20 [Note] Plugin 'FEDERATED' is disabled. InnoDB: The InnoDB memory heap is disabled InnoDB: Mutexes and rw_locks use GCC atomic builtins InnoDB: Compressed tables use zlib 1.2.3 101011 16:36:21 InnoDB: highest supported file format is Barracuda. InnoDB: The log sequence number in ibdata files does not match InnoDB: the log sequence number in the ib_logfiles! 101011 16:36:21 InnoDB: Database was not shut down normally! InnoDB: Starting crash recovery. InnoDB: Reading tablespace information from the .ibd files... InnoDB: Restoring possible half-written data pages from the doublewrite InnoDB: buffer... InnoDB: Last MySQL binlog file position 0 387, file name /var/lib/mysql/zabbixdb-bin.000228 101011 16:36:23 InnoDB Plugin 1.0.12 started; log sequence number 882307352380 101011 16:36:23 [Note] Recovering after a crash using /var/lib/mysql/zabbixdb-bin 101011 16:36:23 [Note] Starting crash recovery... 101011 16:36:23 [Note] Crash recovery finished. 101011 16:36:23 [Note] Event Scheduler: Loaded 0 events 101011 16:36:23 [Note] /usr/sbin/mysqld: ready for connections. Version: '5.1.51-community-log' socket: '/var/lib/mysql/mysql.sock' port: 3306 MySQL Community Server (GPL)