Bug #112252 InnoDB page compression impacts checkpointing

Submitted: 4 Sep 2023 16:20 Modified: 30 Oct 2023 14:13
Reporter: Przemyslaw Malkowski Email Updates:
Status: Analyzing Impact on me:
None 
Category:MySQL Server: InnoDB storage engine Severity:S3 (Non-critical)
Version:8.0.33, 8.0.34 OS:Any
Assigned to: CPU Architecture:Any
Tags: flushing, page compression

File: Maximum allowed size is 50MB.
Description:
Privacy:

If the data you need to attach is more than 50MB, you should create a compressed archive of the data, split it to 50MB chunks, and upload each of them as a separate attachment.

To split a large file:

  • On *nix platforms use the split command e.g. split -b 50MB <my_large_archive> <my_split_archive_prefix>
  • On windows use WinZip or a similar utility to split the large file
[4 Sep 2023 16:21] Przemyslaw Malkowski
Example graphs showing different flushing behavior for compression vs non compression

Attachment: FLushing_compression.png (image/png, text), 77.30 KiB.

[6 Sep 2023 14:22] Przemyslaw Malkowski
adaptive only

Attachment: FLushing_adaptive.png (image/png, text), 33.32 KiB.

[6 Sep 2023 14:22] Przemyslaw Malkowski
sync only

Attachment: FLushing_sync.png (image/png, text), 30.55 KiB.

[8 Sep 2023 13:58] Przemyslaw Malkowski
Graphs from 3 tests, LZ4, ZLIB and none

Attachment: PMM11.pdf (application/pdf, text), 584.71 KiB.

[8 Sep 2023 13:59] Przemyslaw Malkowski
Test details

Attachment: tests_mysqlslap_1.txt (text/plain), 7.95 KiB.

[8 Sep 2023 14:00] Przemyslaw Malkowski
insert script

Attachment: insert1.sql (application/sql, text), 88.97 KiB.

[14 Sep 2023 11:56] Przemyslaw Malkowski
Tests with page_cleaners=BP instances, and io_capacity at 10k; first run is no compression, second run LZ4 compression

Attachment: FLushing_none_vs_compression_high_iocapacity.png (image/png, text), 209.36 KiB.

[18 Oct 2023 12:07] Przemyslaw Malkowski
checkpoint graphs

Attachment: chkp_flushing.png (image/png, text), 58.01 KiB.

[18 Oct 2023 12:07] Przemyslaw Malkowski
CPU utilization during the same test

Attachment: CPU.png (image/png, text), 38.78 KiB.

[23 Oct 2023 13:58] Przemyslaw Malkowski
new examples with innodb_doublewrite_files tuning

Attachment: 2023-10-23_15-25.png (image/png, text), 88.90 KiB.

[23 Oct 2023 14:04] Przemyslaw Malkowski
innodb_doublewrite_files: 2, LZ4

Attachment: 8_0_34_lz4_dblwr-2.svg (image/svg+xml, text), 388.79 KiB.

[23 Oct 2023 14:06] Przemyslaw Malkowski
innodb_doublewrite_files: 16, LZ4

Attachment: 8_0_34_lz4_dblwr-16.svg (image/svg+xml, text), 365.56 KiB.

[23 Oct 2023 14:07] Przemyslaw Malkowski
innodb_doublewrite_files: 16, no compression

Attachment: 8_0_34_dblwr-16-nocompr.svg (image/svg+xml, text), 339.21 KiB.

Portions of this website are copyright © 2001, 2002 The PHP Group

Page generated in 0.043 sec. using MySQL 8.4.7-u6-cloud

Timestamp references displayed by the system are UTC.
Content reproduced on this site is the property of the respective copyright holders.
It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.