> show slave status\G *************************** 1. row *************************** Slave_IO_State: Waiting for master to send event Master_Host: 10.146.2.48 Master_User: repl Master_Port: 3306 Connect_Retry: 60 Master_Log_File: bin-log.017769 Read_Master_Log_Pos: 321786591 Relay_Log_File: relay-log.022243 Relay_Log_Pos: 265384510 Relay_Master_Log_File: bin-log.017698 Slave_IO_Running: Yes Slave_SQL_Running: Yes Replicate_Do_DB: Replicate_Ignore_DB: Replicate_Do_Table: Replicate_Ignore_Table: Replicate_Wild_Do_Table: Replicate_Wild_Ignore_Table: mysql.% Last_Errno: 1756 Last_Error: ... The slave coordinator and worker threads are stopped, possibly leaving data in inconsistent state. A restart should restore consistency automatically, although using non-transactional storage for data or info tables or DDL queries could lead to problems. In such cases you have to examine your data (see documentation for details). Skip_Counter: 0 Exec_Master_Log_Pos: 596020886 Relay_Log_Space: 54239248124 Until_Condition: None Until_Log_File: Until_Log_Pos: 0 Master_SSL_Allowed: No Master_SSL_CA_File: Master_SSL_CA_Path: Master_SSL_Cert: Master_SSL_Cipher: Master_SSL_Key: Seconds_Behind_Master: 178302 Master_SSL_Verify_Server_Cert: No Last_IO_Errno: 0 Last_IO_Error: Last_SQL_Errno: 1756 Last_SQL_Error: ... The slave coordinator and worker threads are stopped, possibly leaving data in inconsistent state. A restart should restore consistency automatically, although using non-transactional storage for data or info tables or DDL queries could lead to problems. In such cases you have to examine your data (see documentation for details). Replicate_Ignore_Server_Ids: Master_Server_Id: 177340976 Master_UUID: b75fd173-b166-11e4-8cff-40a8f01fbe6c Master_Info_File: mysql.slave_master_info SQL_Delay: 3600 SQL_Remaining_Delay: NULL Slave_SQL_Running_State: Waiting for Slave Worker to release partition Master_Retry_Count: 86400 Master_Bind: Last_IO_Error_Timestamp: Last_SQL_Error_Timestamp: 171222 18:01:50 Master_SSL_Crl: Master_SSL_Crlpath: Retrieved_Gtid_Set: a5edc4d2-1bbc-11e7-9ccf-40a8f0200fa4:730112277-8654846783:8654846787-8654846788:8654846790-8654846791:8654846793:8654846796-8654846797:8654846799:8654846801-8654846802:8654846804-8654846805:8654846807-8654846810:8654846812-8654846816:8654846820:8654846823-8654846824:8654846826-8654846828:8654846830-8654846831:8654846833-8654846836:8654846838-8654846841:8654846843:8654846845-8654846846:8654846848:8654846850-8654846851:8654846853-8654846854:8654846856-8654846857:8654846859-8654846863:8654846866-8654846871:8654846873:8654846875-8654846876:8654846879:8654846881-8654846884:8654846886-8654846887:8654846889:8654846891:8654846893-8654846894:8654846897:8654846899-8654846903:8654846905-8654846906:8654846908-8654846946:8654846948:8654846950-8654846972:8654846974:8654846976-8654846978:8654846982-8654846989:8654846991-8654846992:8654846994:8654846996:8654846998:8654847000-8654847001:8654847004-8654847009:8654847015-8654847017:8654847019:8654847021-8654847025:8654847028-8654847030:8654847033:8654847035-8654847038:8654847041, b75fd173-b166-11e4-8cff-40a8f01fbe6c:61766828-63601767 Executed_Gtid_Set: a5edc4d2-1bbc-11e7-9ccf-40a8f0200fa4:1-8579220844:8579220846-8579220848:8579220850-8579220853, b75fd173-b166-11e4-8cff-40a8f01fbe6c:1-63598793, ca1c351e-2cf6-11e7-b757-288023a574f0:1-19 Auto_Position: 1 Replicate_Rewrite_DB: Channel_Name: Master_TLS_Version: 1 row in set (0.00 sec) > stop slave; ^Z [1]+ Stopped mysql-dedicated02-us10 [root@georep30.mc.prod.sea02 ~] # bg [1]+ mysql-dedicated02-us10 & [root@georep30.mc.prod.sea02 ~] # mysql-dedicated02-us10 Welcome to the MySQL monitor. Commands end with ; or \g. Your MySQL connection id is 729 Server version: 5.7.18-16-log Percona Server (GPL), Release 16, Revision d7301f8 Copyright (c) 2009-2017 Percona LLC and/or its affiliates Copyright (c) 2000, 2017, Oracle and/or its affiliates. All rights reserved. Oracle is a registered trademark of Oracle Corporation and/or its affiliates. Other names may be trademarks of their respective owners. Type 'help;' or '\h' for help. Type '\c' to clear the current input statement. > show processlist; +-----+-----------------+-----------+------+---------+--------+-----------------------------------------------+------------------+-----------+---------------+ | Id | User | Host | db | Command | Time | State | Info | Rows_sent | Rows_examined | +-----+-----------------+-----------+------+---------+--------+-----------------------------------------------+------------------+-----------+---------------+ | 1 | system user | | NULL | Connect | 3890 | Waiting for master to send event | NULL | 0 | 0 | | 2 | system user | | NULL | Connect | 1683 | Waiting for Slave Worker to release partition | NULL | 0 | 0 | | 3 | system user | | NULL | Connect | 3890 | Waiting for an event from Coordinator | NULL | 0 | 0 | | 4 | system user | | NULL | Connect | 3890 | Waiting for an event from Coordinator | NULL | 0 | 0 | | 5 | system user | | NULL | Connect | 3890 | Waiting for an event from Coordinator | NULL | 0 | 0 | | 6 | system user | | NULL | Connect | 3890 | Waiting for an event from Coordinator | NULL | 0 | 0 | | 7 | system user | | NULL | Connect | 3890 | Waiting for an event from Coordinator | NULL | 0 | 0 | | 8 | system user | | NULL | Connect | 3890 | Waiting for an event from Coordinator | NULL | 0 | 0 | | 9 | system user | | NULL | Connect | 3890 | Waiting for an event from Coordinator | NULL | 0 | 0 | | 10 | system user | | NULL | Connect | 178827 | Waiting for an event from Coordinator | NULL | 0 | 0 | | 11 | event_scheduler | localhost | NULL | Daemon | 3889 | Waiting on empty queue | NULL | 0 | 0 | | 395 | root | localhost | NULL | Query | 1745 | Killing slave | STOP SLAVE | 0 | 0 | | 636 | root | localhost | NULL | Query | 518 | checking permissions | stop slave | 0 | 0 | | 729 | root | localhost | NULL | Query | 0 | starting | show processlist | 0 | 0 | +-----+-----------------+-----------+------+---------+--------+-----------------------------------------------+------------------+-----------+---------------+ 14 rows in set (0.00 sec) > show slave status\G *************************** 1. row *************************** Slave_IO_State: Waiting for master to send event Master_Host: 10.146.2.48 Master_User: repl Master_Port: 3306 Connect_Retry: 60 Master_Log_File: bin-log.017769 Read_Master_Log_Pos: 472356651 Relay_Log_File: relay-log.022243 Relay_Log_Pos: 265384510 Relay_Master_Log_File: bin-log.017698 Slave_IO_Running: Yes Slave_SQL_Running: Yes Replicate_Do_DB: Replicate_Ignore_DB: Replicate_Do_Table: Replicate_Ignore_Table: Replicate_Wild_Do_Table: Replicate_Wild_Ignore_Table: mysql.% Last_Errno: 1756 Last_Error: ... The slave coordinator and worker threads are stopped, possibly leaving data in inconsistent state. A restart should restore consistency automatically, although using non-transactional storage for data or info tables or DDL queries could lead to problems. In such cases you have to examine your data (see documentation for details). Skip_Counter: 0 Exec_Master_Log_Pos: 596020886 Relay_Log_Space: 54389818184 Until_Condition: None Until_Log_File: Until_Log_Pos: 0 Master_SSL_Allowed: No Master_SSL_CA_File: Master_SSL_CA_Path: Master_SSL_Cert: Master_SSL_Cipher: Master_SSL_Key: Seconds_Behind_Master: 178833 Master_SSL_Verify_Server_Cert: No Last_IO_Errno: 0 Last_IO_Error: Last_SQL_Errno: 1756 Last_SQL_Error: ... The slave coordinator and worker threads are stopped, possibly leaving data in inconsistent state. A restart should restore consistency automatically, although using non-transactional storage for data or info tables or DDL queries could lead to problems. In such cases you have to examine your data (see documentation for details). Replicate_Ignore_Server_Ids: Master_Server_Id: 177340976 Master_UUID: b75fd173-b166-11e4-8cff-40a8f01fbe6c Master_Info_File: mysql.slave_master_info SQL_Delay: 3600 SQL_Remaining_Delay: NULL Slave_SQL_Running_State: Waiting for Slave Worker to release partition Master_Retry_Count: 86400 Master_Bind: Last_IO_Error_Timestamp: Last_SQL_Error_Timestamp: 171222 18:01:50 Master_SSL_Crl: Master_SSL_Crlpath: Retrieved_Gtid_Set: a5edc4d2-1bbc-11e7-9ccf-40a8f0200fa4:730112277-8655054138, b75fd173-b166-11e4-8cff-40a8f01fbe6c:61766828-63601775 Executed_Gtid_Set: a5edc4d2-1bbc-11e7-9ccf-40a8f0200fa4:1-8579220844:8579220846-8579220848:8579220850-8579220853, b75fd173-b166-11e4-8cff-40a8f01fbe6c:1-63598793, ca1c351e-2cf6-11e7-b757-288023a574f0:1-19 Auto_Position: 1 Replicate_Rewrite_DB: Channel_Name: Master_TLS_Version: 1 row in set (0.00 sec) > show engine innodb status\G *************************** 1. row *************************** Type: InnoDB Name: Status: ===================================== 2017-12-22 18:30:10 0x7f352a1cd700 INNODB MONITOR OUTPUT ===================================== Per second averages calculated from the last 5 seconds ----------------- BACKGROUND THREAD ----------------- srv_master_thread loops: 864 srv_active, 0 srv_shutdown, 3043 srv_idle srv_master_thread log flush and writes: 3907 ---------- SEMAPHORES ---------- OS WAIT ARRAY INFO: reservation count 1456 OS WAIT ARRAY INFO: signal count 1438 RW-shared spins 0, rounds 2123, OS waits 1060 RW-excl spins 0, rounds 60, OS waits 2 RW-sx spins 0, rounds 0, OS waits 0 Spin rounds per wait: 2123.00 RW-shared, 60.00 RW-excl, 0.00 RW-sx ------------ TRANSACTIONS ------------ Trx id counter 47418092570 Purge done for trx's n:o < 47418092570 undo n:o < 0 state: running but idle History list length 2 LIST OF TRANSACTIONS FOR EACH SESSION: ---TRANSACTION 421401979328528, not started 0 lock struct(s), heap size 1136, 0 row lock(s) ---TRANSACTION 421401979327336, not started 0 lock struct(s), heap size 1136, 0 row lock(s) ---TRANSACTION 421401979324952, not started 0 lock struct(s), heap size 1136, 0 row lock(s) ---TRANSACTION 421401979323760, not started 0 lock struct(s), heap size 1136, 0 row lock(s) ---TRANSACTION 421401979322568, not started 0 lock struct(s), heap size 1136, 0 row lock(s) ---TRANSACTION 421401979321376, not started 0 lock struct(s), heap size 1136, 0 row lock(s) ---TRANSACTION 421401979320184, not started 0 lock struct(s), heap size 1136, 0 row lock(s) ---TRANSACTION 421401979318992, not started 0 lock struct(s), heap size 1136, 0 row lock(s) ---TRANSACTION 421401979317800, not started 0 lock struct(s), heap size 1136, 0 row lock(s) ---TRANSACTION 421401979315416, not started 0 lock struct(s), heap size 1136, 0 row lock(s) ---TRANSACTION 47418088506, ACTIVE 3907 sec 2 lock struct(s), heap size 1136, 1 row lock(s), undo log entries 1 MySQL thread id 10, OS thread handle 139866317858560, query id 3 Waiting for an event from Coordinator -------- FILE I/O -------- I/O thread 0 state: waiting for completed aio requests (insert buffer thread) I/O thread 1 state: waiting for completed aio requests (log thread) I/O thread 2 state: waiting for completed aio requests (read thread) I/O thread 3 state: waiting for completed aio requests (read thread) I/O thread 4 state: waiting for completed aio requests (read thread) I/O thread 5 state: waiting for completed aio requests (read thread) I/O thread 6 state: waiting for completed aio requests (write thread) I/O thread 7 state: waiting for completed aio requests (write thread) I/O thread 8 state: waiting for completed aio requests (write thread) I/O thread 9 state: waiting for completed aio requests (write thread) Pending normal aio reads: [0, 0, 0, 0] , aio writes: [0, 0, 0, 0] , ibuf aio reads:, log i/o's:, sync i/o's: Pending flushes (fsync) log: 0; buffer pool: 0 1984868 OS file reads, 11344 OS file writes, 8760 OS fsyncs 0.00 reads/s, 0 avg bytes/read, 23.80 writes/s, 7.00 fsyncs/s ------------------------------------- INSERT BUFFER AND ADAPTIVE HASH INDEX ------------------------------------- Ibuf: size 1, free list len 23375, seg size 23377, 0 merges merged operations: insert 0, delete mark 0, delete 0 discarded operations: insert 0, delete mark 0, delete 0 Hash table size 14142761, node heap has 1343 buffer(s) Hash table size 14142761, node heap has 0 buffer(s) Hash table size 14142761, node heap has 1 buffer(s) Hash table size 14142761, node heap has 0 buffer(s) Hash table size 14142761, node heap has 0 buffer(s) Hash table size 14142761, node heap has 0 buffer(s) Hash table size 14142761, node heap has 0 buffer(s) Hash table size 14142761, node heap has 1342 buffer(s) 0.40 hash searches/s, 0.00 non-hash searches/s --- LOG --- Log sequence number 26279762969421 Log flushed up to 26279762969421 Pages flushed up to 26279762969421 Last checkpoint at 26279762969412 Max checkpoint age 869019772 Checkpoint age target 841862905 Modified age 0 Checkpoint age 9 0 pending log flushes, 0 pending chkp writes 4704 log i/o's done, 2.40 log i/o's/second ---------------------- BUFFER POOL AND MEMORY ---------------------- Total large memory allocated 59521892352 Dictionary memory allocated 281606 Internal hash tables (constant factor + variable factor) Adaptive hash index 949177792 (905136704 + 44041088) Page hash 9429272 (buffer pool 0 only) Dictionary cache 226565782 (226284176 + 281606) File system 648664632 (812272 + 647852360) Lock system 147289160 (147276664 + 12496) Recovery system 0 (0 + 0) Buffer pool size 3489366 Buffer pool size, bytes 57169772544 Free buffers 2446756 Database pages 1039924 Old database pages 383859 Modified db pages 0 Pending reads 0 Pending writes: LRU 0, flush list 0, single page 0 Pages made young 201, not young 5221 0.00 youngs/s, 0.00 non-youngs/s Pages read 1039875, created 49, written 4582 0.00 reads/s, 0.00 creates/s, 19.20 writes/s Buffer pool hit rate 1000 / 1000, young-making rate 0 / 1000 not 0 / 1000 Pages read ahead 0.00/s, evicted without access 0.00/s, Random read ahead 0.00/s LRU len: 1039924, unzip_LRU len: 0 I/O sum[630]:cur[0], unzip sum[0]:cur[0] ---------------------- INDIVIDUAL BUFFER POOL INFO ---------------------- ---BUFFER POOL 0 Buffer pool size 581561 Buffer pool size, bytes 9528295424 Free buffers 404987 Database pages 176126 Old database pages 65014 Modified db pages 0 Pending reads 0 Pending writes: LRU 0, flush list 0, single page 0 Pages made young 23, not young 711 0.00 youngs/s, 0.00 non-youngs/s Pages read 176126, created 0, written 743 0.00 reads/s, 0.00 creates/s, 1.20 writes/s Buffer pool hit rate 1000 / 1000, young-making rate 0 / 1000 not 0 / 1000 Pages read ahead 0.00/s, evicted without access 0.00/s, Random read ahead 0.00/s LRU len: 176126, unzip_LRU len: 0 I/O sum[105]:cur[0], unzip sum[0]:cur[0] ---BUFFER POOL 1 Buffer pool size 581561 Buffer pool size, bytes 9528295424 Free buffers 408727 Database pages 172385 Old database pages 63620 Modified db pages 0 Pending reads 0 Pending writes: LRU 0, flush list 0, single page 0 Pages made young 36, not young 755 0.00 youngs/s, 0.00 non-youngs/s Pages read 172371, created 14, written 862 0.00 reads/s, 0.00 creates/s, 3.60 writes/s No buffer pool page gets since the last printout Pages read ahead 0.00/s, evicted without access 0.00/s, Random read ahead 0.00/s LRU len: 172385, unzip_LRU len: 0 I/O sum[105]:cur[0], unzip sum[0]:cur[0] ---BUFFER POOL 2 Buffer pool size 581561 Buffer pool size, bytes 9528295424 Free buffers 410222 Database pages 170891 Old database pages 63102 Modified db pages 0 Pending reads 0 Pending writes: LRU 0, flush list 0, single page 0 Pages made young 0, not young 1012 0.00 youngs/s, 0.00 non-youngs/s Pages read 170891, created 0, written 6 0.00 reads/s, 0.00 creates/s, 0.00 writes/s No buffer pool page gets since the last printout Pages read ahead 0.00/s, evicted without access 0.00/s, Random read ahead 0.00/s LRU len: 170891, unzip_LRU len: 0 I/O sum[105]:cur[0], unzip sum[0]:cur[0] ---BUFFER POOL 3 Buffer pool size 581561 Buffer pool size, bytes 9528295424 Free buffers 409319 Database pages 171795 Old database pages 63396 Modified db pages 0 Pending reads 0 Pending writes: LRU 0, flush list 0, single page 0 Pages made young 78, not young 685 0.00 youngs/s, 0.00 non-youngs/s Pages read 171795, created 0, written 1258 0.00 reads/s, 0.00 creates/s, 6.80 writes/s Buffer pool hit rate 1000 / 1000, young-making rate 0 / 1000 not 0 / 1000 Pages read ahead 0.00/s, evicted without access 0.00/s, Random read ahead 0.00/s LRU len: 171795, unzip_LRU len: 0 I/O sum[105]:cur[0], unzip sum[0]:cur[0] ---BUFFER POOL 4 Buffer pool size 581561 Buffer pool size, bytes 9528295424 Free buffers 407818 Database pages 173296 Old database pages 63950 Modified db pages 0 Pending reads 0 Pending writes: LRU 0, flush list 0, single page 0 Pages made young 63, not young 1047 0.00 youngs/s, 0.00 non-youngs/s Pages read 173296, created 0, written 1326 0.00 reads/s, 0.00 creates/s, 7.40 writes/s Buffer pool hit rate 1000 / 1000, young-making rate 0 / 1000 not 0 / 1000 Pages read ahead 0.00/s, evicted without access 0.00/s, Random read ahead 0.00/s LRU len: 173296, unzip_LRU len: 0 I/O sum[105]:cur[0], unzip sum[0]:cur[0] ---BUFFER POOL 5 Buffer pool size 581561 Buffer pool size, bytes 9528295424 Free buffers 405683 Database pages 175431 Old database pages 64777 Modified db pages 0 Pending reads 0 Pending writes: LRU 0, flush list 0, single page 0 Pages made young 1, not young 1011 0.00 youngs/s, 0.00 non-youngs/s Pages read 175396, created 35, written 387 0.00 reads/s, 0.00 creates/s, 0.20 writes/s No buffer pool page gets since the last printout Pages read ahead 0.00/s, evicted without access 0.00/s, Random read ahead 0.00/s LRU len: 175431, unzip_LRU len: 0 I/O sum[105]:cur[0], unzip sum[0]:cur[0] -------------- ROW OPERATIONS -------------- 0 queries inside InnoDB, 0 queries in queue 0 read views open inside InnoDB 1 RW transactions active inside InnoDB Process ID=28485, Main thread ID=139866109110016, state: sleeping Number of rows inserted 897, updated 2553, deleted 0, read 4627 0.00 inserts/s, 0.40 updates/s, 0.00 deletes/s, 0.40 reads/s ---------------------------- END OF INNODB MONITOR OUTPUT ============================ 1 row in set (0.00 sec) > select @@version -> ; +---------------+ | @@version | +---------------+ | 5.7.18-16-log | +---------------+ 1 row in set (0.00 sec)