Bug #46662 Ndb : mysqlbinlog fails to apply update to table with unique index
Submitted: 11 Aug 2009 21:39 Modified: 8 Oct 2009 17:00
Reporter: Andrew Hutchings Email Updates:
Status: Closed Impact on me:
None 
Category:MySQL Cluster: Replication Severity:S2 (Serious)
Version:mysql-5.1-telco-6.3 OS:Any
Assigned to: Frazer Clement CPU Architecture:Any
Tags: 6.3.20, 7.0.6

[11 Aug 2009 21:39] Andrew Hutchings 
Description:
When using a specific table with a longtext column an update on a primary key appears to be corrupted in the binlog when viewed in mysqlbinlog and gives a duplicate primary key error when replayed in mysql.

How to repeat:
Tested in 6.3.20 and 7.0.6:

1. Start a basic cluster (1 ndbd node will do) with log-bin on
2. Import sql file
3. update LAS set LASname='testme' WHERE lasID=1;
4. drop table LAS
5. Try and re-insert the binary log

090810 21:34:50 [ERROR] Slave SQL: Could not execute Write_rows event on table test.LAS; Duplicate entry '1' for key 'PRIMARY', Error_code: 1062; handler error HA_ERR_FOUND_DUPP_KEY; the event's master log FIRST, end_log_pos 3597, Error_code: 1062
 ERROR 1062 (23000) at line 139: Duplicate entry '1' for key 'PRIMARY'
 
 In the binary log:
 
 ### INSERT INTO mysql.ndb_apply_status 
 ### SET 
 ### @1=1 
 ### @2=1567663063057
 ### @3=''
 ### @4=0
 ### @5=0
 eHSAShcBAAAALwAAAA0OAAAQABEAAAAAAAEAFREAAPwBAAAACmlscHJlYXNyMDU=
 '/*!*/;
 ### INSERT INTO test.LAS
 ### SET
 ### @1=1762263040
 ### @5=NULL
 ### INSERT INTO test.LAS
 ### SET
 ### @1=1920164197
 ### @5='5\x18\x00\x00\x00Y\x00\x00\x00\x03\x03\x03\x0f\x0f\x03\x03\x03\x04\x0f\x04\x03\x03\x03\x0f\x0f\x03\x0f\x0f�\x10(11\x00\x00\x00\x00\x00\x00�\x00�\x00\x00\x00\x00\x00\x00'
[28 Aug 2009 12:18] Jonas Oreland 
how do you do to reapply the binlog ?
[28 Aug 2009 15:37] Andrew Hutchings 
By mysqlbinlog -D | mysql

Although I don't understand how that is relevant because the damage is already done at this point.
[15 Sep 2009 12:28] Frazer Clement 
Issue with output of mysqlbinlog --verbose moved to separate bug : 
bug#47323 mysqlbinlog --verbose displays bad output when events contain subset of columns
[28 Sep 2009 18:11] Frazer Clement 
Proposed fix + testcase against 6.2

Attachment: bug46662-strict-mode.patch (text/x-patch), 3.55 KiB.
[28 Sep 2009 18:13] Frazer Clement 
Proposed patch is against 6.2.

Fix extends 'special handling' of Binlog WRITE_ROW events from slave thread to threads applying BINLOG events.

Testcase verifies scenario where update replicated as write is applied to table containing unique index.
[28 Sep 2009 18:19] Frazer Clement 
Note that patch applies on top of proposed patches for :
 - bug#47323 mysqlbinlog --verbose displays bad output when events contain subset of columns
 - bug#47674 MySQL Cluster : Manually applying binlog zaps unmodified columns
[29 Sep 2009 16:08] Frazer Clement 
Synopsis was "NDB Binary log corruption with longtext"

Apparent corruption was bug with mysqlbinlog --verbose output, corrected by bug#47323.

Failure to apply binlog was actually due to the unique index on the table the event was being applied to.

So Synopsis is changed to :
"Ndb : mysqlbinlog fails to apply update to table with unique index"
[6 Oct 2009 14:21] Bugs System 
A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/commits/85921

3013 Frazer Clement	2009-10-06
      Bug#46662 : Ndb : mysqlbinlog fails to apply update to table with unique index
      modified:
        mysql-test/suite/ndb_binlog/r/ndb_binlog_variants.result
        mysql-test/suite/ndb_binlog/t/ndb_binlog_variants.test
        sql/ha_ndbcluster.cc
        sql/ha_ndbcluster.h
[7 Oct 2009 13:39] Bugs System 
A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/commits/86015

3019 Frazer Clement	2009-10-07
      Bug#46662 : Ndb : mysqlbinlog fails to apply update to table with unique index
      modified:
        mysql-test/suite/ndb_binlog/r/ndb_binlog_variants.result
        mysql-test/suite/ndb_binlog/t/ndb_binlog_variants.test
        sql/ha_ndbcluster.cc
[7 Oct 2009 16:28] Bugs System 
A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/commits/86045

3020 Frazer Clement	2009-10-07
      Bug#46662 : Ndb : mysqlbinlog fails to apply update to table with unique index
      modified:
        mysql-test/suite/ndb_binlog/r/ndb_binlog_variants.result
        mysql-test/suite/ndb_binlog/t/ndb_binlog_variants.test
        sql/ha_ndbcluster.cc
[7 Oct 2009 17:59] Bugs System 
Pushed into 5.1.39-ndb-7.1.0 (revid:frazer@mysql.com-20091007175700-8wd8ryjuod207m53) (version source revid:frazer@mysql.com-20091007175700-8wd8ryjuod207m53) (merge vers: 5.1.39-ndb-7.1.0) (pib:11)
[7 Oct 2009 18:02] Bugs System 
Pushed into 5.1.39-ndb-6.3.28 (revid:frazer@mysql.com-20091007171652-wu5bpgcq3ijt1ods) (version source revid:frazer@mysql.com-20091007171652-wu5bpgcq3ijt1ods) (merge vers: 5.1.39-ndb-6.3.28) (pib:11)
[7 Oct 2009 18:02] Bugs System 
Pushed into 5.1.39-ndb-7.0.9 (revid:frazer@mysql.com-20091007173823-ds7yw5xd652n28vm) (version source revid:frazer@mysql.com-20091007173823-ds7yw5xd652n28vm) (merge vers: 5.1.39-ndb-7.0.9) (pib:11)
[7 Oct 2009 18:03] Bugs System 
Pushed into 5.1.39-ndb-6.2.19 (revid:frazer@mysql.com-20091007162703-ryrg5b743sj1zft5) (version source revid:frazer@mysql.com-20091007162703-ryrg5b743sj1zft5) (merge vers: 5.1.39-ndb-6.2.19) (pib:11)
[8 Oct 2009 15:39] Frazer Clement 
Fix pushed to 
6.2.19
6.3.28
7.0.9
7.1.0
[8 Oct 2009 17:00] Jon Stephens 
Documented bugfix in the NDB-6.2.19, 6.3.28, and 7.0.9 changelogs, as follows:

      mysqlbinlog failed to apply a binary log recorded using
      --log-update-as-write=1.

Closed.
[15 Oct 2009 15:45] Bugs System 
A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/commits/87008

3018 Martin Skold	2009-10-15 [merge]
      Merge
      modified:
        config/ac-macros/ha_ndbcluster.m4
        mysql-test/suite/ndb/my.cnf
        mysql-test/suite/ndb/r/ndb_config.result
        mysql-test/suite/ndb_binlog/r/ndb_binlog_variants.result
        mysql-test/suite/ndb_binlog/t/ndb_binlog_variants.test
        mysql-test/suite/ndb_team/r/ndb_dd_backuprestore.result
        sql/ha_ndbcluster.cc
        sql/ha_ndbcluster.h
        storage/ndb/include/kernel/signaldata/ContinueFragmented.hpp
        storage/ndb/include/kernel/signaldata/DumpStateOrd.hpp
        storage/ndb/include/kernel/signaldata/NodeFailRep.hpp
        storage/ndb/include/ndb_global.h.in
        storage/ndb/include/ndbapi/NdbDictionary.hpp
        storage/ndb/include/ndbapi/NdbOperation.hpp
        storage/ndb/ndbapi-examples/ndbapi_scan/ndbapi_scan.cpp
        storage/ndb/src/kernel/blocks/backup/Backup.cpp
        storage/ndb/src/kernel/blocks/backup/Backup.hpp
        storage/ndb/src/kernel/blocks/cmvmi/Cmvmi.cpp
        storage/ndb/src/kernel/blocks/cmvmi/Cmvmi.hpp
        storage/ndb/src/kernel/blocks/dbdict/Dbdict.cpp
        storage/ndb/src/kernel/blocks/dbdict/Dbdict.hpp
        storage/ndb/src/kernel/blocks/dbdict/printSchemaFile.cpp
        storage/ndb/src/kernel/blocks/dbdih/printSysfile.cpp
        storage/ndb/src/kernel/blocks/dbdih/printSysfile/printSysfile.cpp
        storage/ndb/src/kernel/blocks/dblqh/DblqhMain.cpp
        storage/ndb/src/kernel/blocks/dblqh/redoLogReader/reader.cpp
        storage/ndb/src/kernel/blocks/dbtc/Dbtc.hpp
        storage/ndb/src/kernel/blocks/dbtc/DbtcMain.cpp
        storage/ndb/src/kernel/blocks/dbtup/Dbtup.hpp
        storage/ndb/src/kernel/blocks/dbtup/DbtupGen.cpp
        storage/ndb/src/kernel/blocks/dbtup/tuppage.hpp
        storage/ndb/src/kernel/blocks/dbtux/Dbtux.hpp
        storage/ndb/src/kernel/blocks/dbutil/DbUtil.cpp
        storage/ndb/src/kernel/blocks/dbutil/DbUtil.hpp
        storage/ndb/src/kernel/blocks/lgman.cpp
        storage/ndb/src/kernel/blocks/lgman.hpp
        storage/ndb/src/kernel/blocks/ndbcntr/NdbcntrMain.cpp
        storage/ndb/src/kernel/blocks/qmgr/QmgrMain.cpp
        storage/ndb/src/kernel/blocks/suma/Suma.cpp
        storage/ndb/src/kernel/blocks/suma/Suma.hpp
        storage/ndb/src/kernel/blocks/trix/Trix.hpp
        storage/ndb/src/kernel/blocks/tsman.cpp
        storage/ndb/src/kernel/blocks/tsman.hpp
        storage/ndb/src/kernel/vm/DLFifoList.hpp
        storage/ndb/src/kernel/vm/DLHashTable.hpp
        storage/ndb/src/kernel/vm/DLList.hpp
        storage/ndb/src/kernel/vm/DataBuffer.hpp
        storage/ndb/src/kernel/vm/SimulatedBlock.cpp
        storage/ndb/src/kernel/vm/SimulatedBlock.hpp
        storage/ndb/src/mgmapi/LocalConfig.cpp
        storage/ndb/src/mgmapi/Makefile.am
        storage/ndb/src/mgmsrv/ConfigInfo.cpp
        storage/ndb/src/ndbapi/NdbDictionary.cpp
        storage/ndb/src/ndbapi/NdbOperation.cpp
        storage/ndb/test/ndbapi/testNdbApi.cpp
        storage/ndb/test/run-test/daily-basic-tests.txt