MySQL Bugs: #88658: The mysql hang when session insert，the disk util is 100%

Bug #88658	The mysql hang when session insert，the disk util is 100%
Submitted:	26 Nov 2017 7:56	Modified:	26 Dec 2017 14:44
Reporter:	wangwang wang	Email Updates:
Status:	No Feedback	Impact on me:	None
Category:	MySQL Server: InnoDB storage engine	Severity:	S3 (Non-critical)
Version:	5.7.14	OS:	Red Hat (7.2)
Assigned to:		CPU Architecture:	Any

Description:
2017-11-25T11:21:55.835551+08:00 0 [ERROR] /usr/local/mysql/bin/mysqld: Got timeout reading communication packets
2017-11-25T11:21:55.835823+08:00 0 [ERROR] /usr/local/mysql/bin/mysqld: Got a packet bigger than 'max_allowed_packet' bytes
2017-11-25T11:21:55.835845+08:00 0 [ERROR] /usr/local/mysql/bin/mysqld: Got packets out of order
2017-11-25T11:21:55.835940+08:00 0 [ERROR] /usr/local/mysql/bin/mysqld: Got a packet bigger than 'max_allowed_packet' bytes
2017-11-25T11:21:55.835955+08:00 0 [ERROR] /usr/local/mysql/bin/mysqld: Got packets out of order
2017-11-25T11:21:55.835962+08:00 0 [ERROR] /usr/local/mysql/bin/mysqld: Got packets out of order
2017-11-25T11:21:55.835967+08:00 0 [ERROR] /usr/local/mysql/bin/mysqld: Got packets out of order
2017-11-25T11:21:55.835972+08:00 0 [ERROR] /usr/local/mysql/bin/mysqld: Got packets out of order
2017-11-25T11:21:55.835977+08:00 0 [ERROR] /usr/local/mysql/bin/mysqld: Got packets out of order
2017-11-25T11:52:57.058381+08:00 0 [Warning] InnoDB: A long semaphore wait:
--Thread 140458978047744 has waited at row0ins.cc line 2973 for 243.00 seconds the semaphore:
X-lock on RW-latch at 0x7fd8074743a8 created in file buf0buf.cc line 1457
a writer (thread id 140457977259776) has reserved it in mode  SX
number of readers 0, waiters flag 1, lock_word: 10000000
Last time read locked in file dict0stats.cc line 1484
Last time write locked in file /export/home/pb2/build/sb_0-19699473-1468326131.83/mysqlcom-pro-5.7.14/storage/innobase/buf/buf0flu.cc line 1198
2017-11-25T11:52:57.058497+08:00 0 [Warning] InnoDB: A long semaphore wait:
--Thread 140458982307584 has waited at row0ins.cc line 2973 for 241.00 seconds the semaphore:
X-lock on RW-latch at 0x7fd80747ef28 created in file buf0buf.cc line 1457
a writer (thread id 140457977259776) has reserved it in mode  SX
number of readers 0, waiters flag 1, lock_word: 10000000
Last time read locked in file dict0stats.cc line 1484
Last time write locked in file /export/home/pb2/build/sb_0-19699473-1468326131.83/mysqlcom-pro-5.7.14/storage/innobase/buf/buf0flu.cc line 1198
2017-11-25T11:52:57.058620+08:00 0 [Warning] InnoDB: A long semaphore wait:
--Thread 140459213469440 has waited at row0ins.cc line 2973 for 242.00 seconds the semaphore:
X-lock on RW-latch at 0x7fd807473768 created in file buf0buf.cc line 1457
a writer (thread id 140457977259776) has reserved it in mode  SX
number of readers 0, waiters flag 1, lock_word: 10000000
Last time read locked in file dict0stats.cc line 1484
Last time write locked in file /export/home/pb2/build/sb_0-19699473-1468326131.83/mysqlcom-pro-5.7.14/storage/innobase/buf/buf0flu.cc line 1198
2017-11-25T11:52:57.058685+08:00 0 [Warning] InnoDB: A long semaphore wait:
--Thread 140458974320384 has waited at row0ins.cc line 2973 for 241.00 seconds the semaphore:
X-lock on RW-latch at 0x7fd8074746b8 created in file buf0buf.cc line 1457
a writer (thread id 140457977259776) has reserved it in mode  SX
number of readers 0, waiters flag 1, lock_word: 10000000
Last time read locked in file dict0stats.cc line 1484
Last time write locked in file /export/home/pb2/build/sb_0-19699473-1468326131.83/mysqlcom-pro-5.7.14/storage/innobase/buf/buf0flu.cc line 1198
InnoDB: ###### Starts InnoDB Monitor for 30 secs to print diagnostic info:
InnoDB: Pending preads 0, pwrites 2
2017-11-25T11:52:57.273066+08:00 0 [Note] InnoDB: page_cleaner: 1000ms intended loop took 242956ms. The settings might not be optimal. (flushed=5671 and evicted=0, during the time.)

How to repeat:
Half an hour later, the problem repeat

show full processlist

Attachment: show full processlist.txt (text/plain), 1.82 MiB.

error

Attachment: yldb-01.rar (application/octet-stream, text), 87.31 KiB.

io util

Attachment: 20171126155415.jpg (image/jpeg, text), 84.92 KiB.

To report a bug please try the latest released version first, current is 5.7.20 and provide a repeatable test case. Thanks.

No feedback was provided for this bug for over a month, so it is
being suspended automatically. If you are able to provide the
information that was originally requested, please do so and change
the status of the bug back to "Open".