Bug #62684 slave hangs with Slave SQL: Could not execute Delete_rows event on table ...

• Submitted: 11 Oct 2011 17:58
• Modified: 4 Apr 2012 18:21
• Reporter: dan f
• Status: Closed
• Category: MySQL Server: Replication
• Severity: S1 (Critical)
• Version: 5.5.15
• OS: Linux (CentOS release 5.6 (Final) )
• CPU Architecture: Any
• Tags: hangs, replication, slave

[11 Oct 2011 17:58] dan f

Description:
mysql 5.5.15 slave hangs with cpu pegged at 1. master is doing delete of MyISAM table all rows and then importing new data. slave fails during delete and seems to roll tx forward and back forever. command is simple delete from catalog.dit_collection_song. master is 5.5.15 and replication is MIXED mode. slave is 5.5.15 as well. get the same message over and over about every 3 minutes in our mysql.err file:

111011 13:24:49 [Warning] Slave SQL: Could not execute Delete_rows event on table catalog.dit_collection_song; Can't find record in 'dit_collection_song', Error_code: 1032; Can't find record in 'dit_collection_song', Error_code: 1032; Can't find record in 'dit_collection_song', Error_code: 1032; Can't find record in 'dit_collection_song', Error_code: 1032; Can't find record in 'dit_collection_song', Error_code: 1032; Can't find record in 'dit_collection_song', Error_code: 1032; Can't find record in 'dit_collection_song', Error_code: 1032; Can't find record in 'dit_collection_song', Error_code: 1032; Can't find record in 'dit_collection_song', Error_code: 1032; Can't find record in 'dit_collection_song', Error_code: 1032; Can't find record in 'dit_collection_song', Error_code: 1032; Can't find record in 'dit_collection_song', Error_code: 1032; Can't find record in 'dit_collection_song', Error_code: 1032; Can't find record in 'dit_collection_song', Error_code: 1032; Can't find record in 'dit_collection_song', Error_code: 1032; Can't fi

How to repeat:
fails ever week at the same point in our catalog update, after the delete from catalog.dit_collection_song.

Suggested fix:
not sure, why does delete fail, and why does rollback fail as well?

[11 Oct 2011 18:01] dan f

mysql.err file

Attachment: mysql_hang.txt (text/plain), 3.19 KiB.

[11 Oct 2011 18:29] dan f

there are 32492271 rows in the dit_collection_song table, fyi.

[11 Oct 2011 19:31] Valeriy Kravchuk

Please, send the output of:

show create table dit_collection_song\G

from slave.

[11 Oct 2011 21:52] dan f

| dit_collection_song | CREATE TABLE `dit_collection_song` (
  `export_date` varchar(255) CHARACTER SET ascii DEFAULT NULL,
  `collection_id` varchar(255) CHARACTER SET ucs2 DEFAULT NULL,
  `song_id` varchar(255) CHARACTER SET ucs2 DEFAULT NULL,
  `track_number` varchar(255) CHARACTER SET ucs2 DEFAULT NULL,
  `volume_number` varchar(255) CHARACTER SET ucs2 DEFAULT NULL,
  `preorder_only` varchar(255) CHARACTER SET ucs2 DEFAULT NULL
) ENGINE=MyISAM DEFAULT CHARSET=latin1 |

[26 Dec 2011 19:37] Sveta Smirnova

Thank you for the feedback.

These errors can mean slave can not find many rows. Do you write into same table on slave? Please send us binary log where problem DELETE is located.

[27 Jan 2012 1:00] Bugs System

No feedback was provided for this bug for over a month, so it is
being suspended automatically. If you are able to provide the
information that was originally requested, please do so and change
the status of the bug back to "Open".

[4 Apr 2012 18:21] dan f

we've done tests with 5.5.21 and this issue seems to have gone away.

thanks for the help,