070108 00:24:34 mysqld started /opt/mysql-5.1.14-beta/bin/mysqld: Table 'slow_log' is marked as crashed and should be repaired 070108 0:24:46 [Warning] 'user' entry 'root@node2-iss' ignored in --skip-name-resolve mode. 070108 0:24:46 [Warning] 'user' entry '@node2-iss' ignored in --skip-name-resolve mode. 070108 0:24:46 [Warning] 'user' entry 'repl@templar2.atlas.ops.us.digitar.com' ignored in --skip-name-resolve mode. 070108 0:24:46 [Warning] Neither --relay-log nor --relay-log-index were used; so replication may break when this MySQL server acts as a slave and has his hostname changed!! Please use '--relay-log=iss-relay-bin' to avoid this problem. 070108 0:24:46 [Note] /opt/mysql-5.1.14-beta/bin/mysqld: ready for connections. Version: '5.1.14-beta-standard-debug-log' socket: '/tmp/mysql.sock' port: 3306 Source distribution 070108 0:24:46 [Note] Slave SQL thread initialized, starting replication in log 'FIRST' at position 0, relay log './iss-relay-bin.000001' position: 4 070108 0:24:46 [Note] SCHEDULER: Loaded 0 events 070108 0:24:46 [ERROR] Slave I/O thread: error connecting to master 'repl@10.1.58.25:3306': Error: 'Host '10.1.58.19' is not allowed to connect to this MySQL server' errno: 1130 retry-time: 60 retries: 86400 070108 0:25:04 [Note] /opt/mysql-5.1.14-beta/bin/mysqld: Normal shutdown 070108 0:25:04 [Note] SCHEDULER: Purging queue. 0 events 070108 0:25:04 [Note] Slave I/O thread killed while connecting to master 070108 0:25:04 [Note] Slave I/O thread exiting, read up to log 'FIRST', position 4 070108 0:25:04 [Note] Error reading relay log event: slave SQL thread was killed 070108 0:25:04 [Note] /opt/mysql-5.1.14-beta/bin/mysqld: Shutdown complete 070108 00:25:04 mysqld ended 070108 00:25:42 mysqld started 070108 0:25:43 [Warning] 'user' entry 'root@node2-iss' ignored in --skip-name-resolve mode. 070108 0:25:43 [Warning] 'user' entry '@node2-iss' ignored in --skip-name-resolve mode. 070108 0:25:43 [Warning] 'user' entry 'repl@templar2.atlas.ops.us.digitar.com' ignored in --skip-name-resolve mode. 070108 0:25:43 [Warning] Neither --relay-log nor --relay-log-index were used; so replication may break when this MySQL server acts as a slave and has his hostname changed!! Please use '--relay-log=iss-relay-bin' to avoid this problem. 070108 0:25:43 [Note] /opt/mysql-5.1.14-beta/bin/mysqld: ready for connections. Version: '5.1.14-beta-standard-debug-log' socket: '/tmp/mysql.sock' port: 3306 Source distribution 070108 0:25:43 [Note] Slave SQL thread initialized, starting replication in log 'FIRST' at position 0, relay log './iss-relay-bin.000001' position: 4 070108 0:25:43 [Note] SCHEDULER: Loaded 0 events 070108 0:25:43 [ERROR] Slave I/O thread: error connecting to master 'repl@10.1.58.25:3306': Error: 'Host '10.1.58.19' is not allowed to connect to this MySQL server' errno: 1130 retry-time: 60 retries: 86400 070108 0:27:05 [Note] Slave I/O thread killed while connecting to master 070108 0:27:05 [Note] Slave I/O thread exiting, read up to log 'FIRST', position 4 070108 0:27:05 [Note] Error reading relay log event: slave SQL thread was killed 070108 0:28:25 [Note] Slave SQL thread initialized, starting replication in log 'mysql-bin.000064' at position 4810846, relay log './iss-relay-bin.000001' position: 4 070108 0:28:25 [Note] Slave I/O thread: connected to master 'repl@10.1.58.25:3306',replication started in log 'mysql-bin.000064' at position 4810846 070108 0:28:26 [ERROR] The slave I/O thread stops because master and slave have equal MySQL server ids; these ids must be different for replication to work (or the --replicate-same-server-id option must be used on slave but this does not always make sense; please check the manual before using it). 070108 0:28:26 [Note] Slave I/O thread exiting, read up to log 'mysql-bin.000064', position 4810846 070108 0:28:42 [Note] Error reading relay log event: slave SQL thread was killed 070108 0:28:49 [Note] /opt/mysql-5.1.14-beta/bin/mysqld: Normal shutdown 070108 0:28:49 [Note] SCHEDULER: Purging queue. 0 events 070108 0:28:49 [Note] /opt/mysql-5.1.14-beta/bin/mysqld: Shutdown complete 070108 00:28:49 mysqld ended 070108 00:29:27 mysqld started 070108 0:29:27 [Warning] 'user' entry 'root@node2-iss' ignored in --skip-name-resolve mode. 070108 0:29:27 [Warning] 'user' entry '@node2-iss' ignored in --skip-name-resolve mode. 070108 0:29:27 [Warning] 'user' entry 'repl@templar2.atlas.ops.us.digitar.com' ignored in --skip-name-resolve mode. 070108 0:29:27 [Warning] Neither --relay-log nor --relay-log-index were used; so replication may break when this MySQL server acts as a slave and has his hostname changed!! Please use '--relay-log=iss-relay-bin' to avoid this problem. 070108 0:29:27 [Note] /opt/mysql-5.1.14-beta/bin/mysqld: ready for connections. Version: '5.1.14-beta-standard-debug-log' socket: '/tmp/mysql.sock' port: 3306 Source distribution 070108 0:29:27 [Note] Slave SQL thread initialized, starting replication in log 'mysql-bin.000064' at position 4810846, relay log './iss-relay-bin.000001' position: 4 070108 0:29:27 [Note] SCHEDULER: Loaded 0 events 070108 0:29:27 [Note] Slave I/O thread: connected to master 'repl@10.1.58.25:3306',replication started in log 'mysql-bin.000064' at position 4810846 070108 0:41:39 [Note] Slave: received end packet from server, apparent master shutdown: 070108 0:41:39 [Note] Slave I/O thread: Failed reading log event, reconnecting to retry, log 'mysql-bin.000064' position 12975448 070108 0:41:39 [ERROR] Slave I/O thread: error reconnecting to master 'repl@10.1.58.25:3306': Error: 'Lost connection to MySQL server at 'reading initial communication packet', system error: 146' errno: 2013 retry-time: 60 retries: 86400 070108 0:42:39 [Note] Slave: connected to master 'repl@10.1.58.25:3306',replication resumed in log 'mysql-bin.000064' at position 12975448 070108 2:20:03 [ERROR] Error reading packet from server: Lost connection to MySQL server during query ( server_errno=2013) 070108 2:20:03 [Note] Slave I/O thread: Failed reading log event, reconnecting to retry, log 'mysql-bin.000065' position 34778763 070108 2:20:03 [ERROR] Slave I/O thread: error reconnecting to master 'repl@10.1.58.25:3306': Error: 'Lost connection to MySQL server at 'reading initial communication packet', system error: 146' errno: 2013 retry-time: 60 retries: 86400 070108 2:59:21 [Note] Slave I/O thread killed during or after a reconnect done to recover from failed read 070108 2:59:21 [Note] Slave I/O thread exiting, read up to log 'mysql-bin.000065', position 34778763 070108 2:59:21 [Note] Error reading relay log event: slave SQL thread was killed mysqld got signal 11; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. key_buffer_size=262144000 read_buffer_size=2093056 max_used_connections=103 max_connections=350 threads_connected=103 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_connections = 1329797 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. 070108 04:30:07 mysqld restarted 070108 4:30:07 [ERROR] /opt/mysql-5.1.14-beta/bin/mysqld: Table './mysql/user' is marked as crashed and should be repaired 070108 4:30:07 [Warning] Checking table: './mysql/user' 070108 4:30:07 [ERROR] 1 client is using or hasn't closed the table properly 070108 4:30:07 [Warning] 'user' entry 'root@node2-iss' ignored in --skip-name-resolve mode. 070108 4:30:07 [Warning] 'user' entry '@node2-iss' ignored in --skip-name-resolve mode. 070108 4:30:07 [Warning] 'user' entry 'repl@templar2.atlas.ops.us.digitar.com' ignored in --skip-name-resolve mode. 070108 4:30:07 [Warning] Neither --relay-log nor --relay-log-index were used; so replication may break when this MySQL server acts as a slave and has his hostname changed!! Please use '--relay-log=iss-relay-bin' to avoid this problem. 070108 4:30:07 [Note] /opt/mysql-5.1.14-beta/bin/mysqld: ready for connections. Version: '5.1.14-beta-standard-debug-log' socket: '/tmp/mysql.sock' port: 3306 Source distribution 070108 4:30:07 [Note] Slave SQL thread initialized, starting replication in log 'mysql-bin.000065' at position 34778763, relay log './iss-relay-bin.000005' position: 34778904 070108 4:30:07 [Note] SCHEDULER: Loaded 0 events 070108 4:30:07 [ERROR] Slave I/O thread: error connecting to master 'repl@10.1.58.25:3306': Error: 'Lost connection to MySQL server at 'reading initial communication packet', system error: 146' errno: 2013 retry-time: 60 retries: 86400 070108 4:32:15 [ERROR] /opt/mysql-5.1.14-beta/bin/mysqld: Table './dspam/dspam_token_data' is marked as crashed and should be repaired 070108 4:32:15 [Warning] Checking table: './dspam/dspam_token_data' 070108 4:34:46 [ERROR] /opt/mysql-5.1.14-beta/bin/mysqld: Table './dspam/dspam_virtual_uids' is marked as crashed and should be repaired 070108 4:34:46 [Warning] Checking table: './dspam/dspam_virtual_uids' 070108 4:35:44 [ERROR] /opt/mysql-5.1.14-beta/bin/mysqld: Table './dspam/dspam_stats' is marked as crashed and should be repaired 070108 4:35:44 [Warning] Checking table: './dspam/dspam_stats' 070108 4:36:01 [ERROR] /opt/mysql-5.1.14-beta/bin/mysqld: Table './dspam/dspam_signature_data' is marked as crashed and should be repaired 070108 4:36:01 [Warning] Checking table: './dspam/dspam_signature_data' 070108 5:09:46 [Note] /opt/mysql-5.1.14-beta/bin/mysqld: Normal shutdown 070108 5:09:46 [Note] SCHEDULER: Purging queue. 0 events 070108 5:09:46 [Note] Slave I/O thread killed while connecting to master 070108 5:09:46 [Note] Slave I/O thread exiting, read up to log 'mysql-bin.000065', position 34778763 070108 5:09:46 [Note] Error reading relay log event: slave SQL thread was killed 070108 5:09:47 [Note] /opt/mysql-5.1.14-beta/bin/mysqld: Shutdown complete 070108 05:09:47 mysqld ended 070108 05:15:27 mysqld started 070108 5:15:30 InnoDB: Log file /node1_iss_mysql_logs/ib_logfile0 did not exist: new to be created InnoDB: Setting log file /node1_iss_mysql_logs/ib_logfile0 size to 750 MB InnoDB: Database physically writes the file full: wait... InnoDB: Progress in MB: 100 200 300 400 500 600 700 070108 5:15:40 InnoDB: Log file /node1_iss_mysql_logs/ib_logfile1 did not exist: new to be created InnoDB: Setting log file /node1_iss_mysql_logs/ib_logfile1 size to 750 MB InnoDB: Database physically writes the file full: wait... InnoDB: Progress in MB: 100 200 300 400 500 600 700 070108 5:15:49 InnoDB: Log file /node1_iss_mysql_logs/ib_logfile2 did not exist: new to be created InnoDB: Setting log file /node1_iss_mysql_logs/ib_logfile2 size to 750 MB InnoDB: Database physically writes the file full: wait... InnoDB: Progress in MB: 100 200 300 400 500 600 700 070108 5:15:58 InnoDB: Database was not shut down normally! InnoDB: Starting crash recovery. InnoDB: Reading tablespace information from the .ibd files... InnoDB: Restoring possible half-written data pages from the doublewrite InnoDB: buffer... 070108 5:15:58 InnoDB: Starting log scan based on checkpoint at InnoDB: log sequence number 0 46604. InnoDB: Doing recovery: scanned up to log sequence number 0 46604 070108 5:15:59 InnoDB: Started; log sequence number 0 46604 070108 5:15:59 [Warning] 'user' entry 'root@node2-iss' ignored in --skip-name-resolve mode. 070108 5:15:59 [Warning] 'user' entry '@node2-iss' ignored in --skip-name-resolve mode. 070108 5:15:59 [Warning] 'user' entry 'repl@templar2.atlas.ops.us.digitar.com' ignored in --skip-name-resolve mode. 070108 5:15:59 [Warning] Neither --relay-log nor --relay-log-index were used; so replication may break when this MySQL server acts as a slave and has his hostname changed!! Please use '--relay-log=iss-relay-bin' to avoid this problem. 070108 5:15:59 [Note] /opt/mysql-5.1.14-beta/bin/mysqld: ready for connections. Version: '5.1.14-beta-standard-debug-log' socket: '/tmp/mysql.sock' port: 3306 Source distribution 070108 5:15:59 [Note] Slave SQL thread initialized, starting replication in log 'mysql-bin.000065' at position 34778763, relay log './iss-relay-bin.000006' position: 4 070108 5:15:59 [Note] SCHEDULER: Loaded 0 events 070108 5:15:59 [ERROR] Slave I/O thread: error connecting to master 'repl@10.1.58.25:3306': Error: 'Lost connection to MySQL server at 'reading initial communication packet', system error: 146' errno: 2013 retry-time: 60 retries: 86400 070108 5:16:46 [Note] Slave I/O thread killed while connecting to master 070108 5:16:46 [Note] Slave I/O thread exiting, read up to log 'mysql-bin.000065', position 34778763 070108 5:16:46 [Note] Error reading relay log event: slave SQL thread was killed