Description:
When Master's binary log replicate to Slave, I found the rows in binary log but it didn't apply to data.
It is daily batch job which is running at 2:00 AM.
When Master update a row from yesterday to today, Slave got replication error.
I noticed that slave data's date is not yesterday but 2 days ago.
# Slave Error Log
2024-11-29T17:20:35.801610Z 354213 [ERROR] [MY-010584] [Repl] Replica SQL for channel '': Worker 1 failed executing transaction 'ANONYMOUS' at source log mysql-bin.000214, end_log_pos
50431634; Could not execute Update_rows event on table mdlc.t_sys_user_if; Can't find record in 't_sys_user_if', Error_code: 1032; handler error HA_ERR_END_OF_FILE; the event's sourc
e log mysql-bin.000214, end_log_pos 50431634, Error_code: MY-001032
2024-11-29T22:02:54.029298Z 1507867 [System] [MY-014001] [Repl] Replica receiver thread for channel '': connected to source 'repl@172.20.50.48:3306' with server_uuid=65ba7ab8-1e42-11e
f-86ec-005056a9c28c, server_id=1. Starting replication from file 'mysql-bin.000214', position '231458965'.
mysql> show replica status\G
*************************** 1. row ***************************
Replica_IO_State: Waiting for source to send event
Source_Host: 172.20.50.48
Source_User: repl
Source_Port: 3306
Connect_Retry: 60
Source_Log_File: mysql-bin.000214
Read_Source_Log_Pos: 515017127
Relay_Log_File: mysqld-relay-bin.000052
Relay_Log_Pos: 50431199
Relay_Source_Log_File: mysql-bin.000214
Replica_IO_Running: Yes
Replica_SQL_Running: No
Replicate_Do_DB:
Replicate_Ignore_DB:
Replicate_Do_Table:
Replicate_Ignore_Table:
Replicate_Wild_Do_Table:
Replicate_Wild_Ignore_Table:
Last_Errno: 1032
Last_Error: Coordinator stopped because there were error(s) in the worker(s). The most recent failure being: Worker 1 failed executing transaction 'ANONYMOUS' at source log mysql-bin.000214, end_log_pos 50431634. See error log and/or performance_schema.replication_applier_status_by_worker table for more details about this failure or others, if any.
Skip_Counter: 0
Exec_Source_Log_Pos: 50430983
Relay_Log_Space: 515017981
Until_Condition: None
Until_Log_File:
Until_Log_Pos: 0
Source_SSL_Allowed: No
Source_SSL_CA_File:
Source_SSL_CA_Path:
Source_SSL_Cert:
Source_SSL_Cipher:
Source_SSL_Key:
Seconds_Behind_Source: NULL
Source_SSL_Verify_Server_Cert: No
Last_IO_Errno: 0
Last_IO_Error:
Last_SQL_Errno: 1032
Last_SQL_Error: Coordinator stopped because there were error(s) in the worker(s). The most recent failure being: Worker 1 failed executing transaction 'ANONYMOUS' at source log mysql-bin.000214, end_log_pos 50431634. See error log and/or performance_schema.replication_applier_status_by_worker table for more details about this failure or others, if any.
Replicate_Ignore_Server_Ids:
Source_Server_Id: 1
Source_UUID: 65ba7ab8-1e42-11ef-86ec-005056a9c28c
Source_Info_File: mysql.slave_master_info
SQL_Delay: 0
SQL_Remaining_Delay: NULL
Replica_SQL_Running_State:
Source_Retry_Count: 86400
Source_Bind:
Last_IO_Error_Timestamp:
Last_SQL_Error_Timestamp: 241130 07:02:54
Source_SSL_Crl:
Source_SSL_Crlpath:
Retrieved_Gtid_Set:
Executed_Gtid_Set:
Auto_Position: 0
Replicate_Rewrite_DB:
Channel_Name:
Source_TLS_Version:
Source_public_key_path:
Get_Source_public_key: 0
Network_Namespace:
1 row in set (0.00 sec)
How to repeat:
Don't know host to repeat.
Description: When Master's binary log replicate to Slave, I found the rows in binary log but it didn't apply to data. It is daily batch job which is running at 2:00 AM. When Master update a row from yesterday to today, Slave got replication error. I noticed that slave data's date is not yesterday but 2 days ago. # Slave Error Log 2024-11-29T17:20:35.801610Z 354213 [ERROR] [MY-010584] [Repl] Replica SQL for channel '': Worker 1 failed executing transaction 'ANONYMOUS' at source log mysql-bin.000214, end_log_pos 50431634; Could not execute Update_rows event on table mdlc.t_sys_user_if; Can't find record in 't_sys_user_if', Error_code: 1032; handler error HA_ERR_END_OF_FILE; the event's sourc e log mysql-bin.000214, end_log_pos 50431634, Error_code: MY-001032 2024-11-29T22:02:54.029298Z 1507867 [System] [MY-014001] [Repl] Replica receiver thread for channel '': connected to source 'repl@172.20.50.48:3306' with server_uuid=65ba7ab8-1e42-11e f-86ec-005056a9c28c, server_id=1. Starting replication from file 'mysql-bin.000214', position '231458965'. mysql> show replica status\G *************************** 1. row *************************** Replica_IO_State: Waiting for source to send event Source_Host: 172.20.50.48 Source_User: repl Source_Port: 3306 Connect_Retry: 60 Source_Log_File: mysql-bin.000214 Read_Source_Log_Pos: 515017127 Relay_Log_File: mysqld-relay-bin.000052 Relay_Log_Pos: 50431199 Relay_Source_Log_File: mysql-bin.000214 Replica_IO_Running: Yes Replica_SQL_Running: No Replicate_Do_DB: Replicate_Ignore_DB: Replicate_Do_Table: Replicate_Ignore_Table: Replicate_Wild_Do_Table: Replicate_Wild_Ignore_Table: Last_Errno: 1032 Last_Error: Coordinator stopped because there were error(s) in the worker(s). The most recent failure being: Worker 1 failed executing transaction 'ANONYMOUS' at source log mysql-bin.000214, end_log_pos 50431634. See error log and/or performance_schema.replication_applier_status_by_worker table for more details about this failure or others, if any. Skip_Counter: 0 Exec_Source_Log_Pos: 50430983 Relay_Log_Space: 515017981 Until_Condition: None Until_Log_File: Until_Log_Pos: 0 Source_SSL_Allowed: No Source_SSL_CA_File: Source_SSL_CA_Path: Source_SSL_Cert: Source_SSL_Cipher: Source_SSL_Key: Seconds_Behind_Source: NULL Source_SSL_Verify_Server_Cert: No Last_IO_Errno: 0 Last_IO_Error: Last_SQL_Errno: 1032 Last_SQL_Error: Coordinator stopped because there were error(s) in the worker(s). The most recent failure being: Worker 1 failed executing transaction 'ANONYMOUS' at source log mysql-bin.000214, end_log_pos 50431634. See error log and/or performance_schema.replication_applier_status_by_worker table for more details about this failure or others, if any. Replicate_Ignore_Server_Ids: Source_Server_Id: 1 Source_UUID: 65ba7ab8-1e42-11ef-86ec-005056a9c28c Source_Info_File: mysql.slave_master_info SQL_Delay: 0 SQL_Remaining_Delay: NULL Replica_SQL_Running_State: Source_Retry_Count: 86400 Source_Bind: Last_IO_Error_Timestamp: Last_SQL_Error_Timestamp: 241130 07:02:54 Source_SSL_Crl: Source_SSL_Crlpath: Retrieved_Gtid_Set: Executed_Gtid_Set: Auto_Position: 0 Replicate_Rewrite_DB: Channel_Name: Source_TLS_Version: Source_public_key_path: Get_Source_public_key: 0 Network_Namespace: 1 row in set (0.00 sec) How to repeat: Don't know host to repeat.