Bug #112252 InnoDB page compression impacts checkpointing
Submitted: 4 Sep 2023 16:20 Modified: 30 Oct 2023 14:13
Reporter: Przemyslaw Malkowski Email Updates:
Status: Analyzing Impact on me:
None 
Category:MySQL Server: InnoDB storage engine Severity:S3 (Non-critical)
Version:8.0.33, 8.0.34 OS:Any
Assigned to: CPU Architecture:Any
Tags: flushing, page compression

File: Maximum allowed size is 50MB.
Description:
Privacy:

If the data you need to attach is more than 50MB, you should create a compressed archive of the data, split it to 50MB chunks, and upload each of them as a separate attachment.

To split a large file:

[4 Sep 2023 16:21] Przemyslaw Malkowski
Example graphs showing different flushing behavior for compression vs non compression

Attachment: FLushing_compression.png (image/png, text), 77.30 KiB.

[6 Sep 2023 14:22] Przemyslaw Malkowski
adaptive only

Attachment: FLushing_adaptive.png (image/png, text), 33.32 KiB.

[6 Sep 2023 14:22] Przemyslaw Malkowski
sync only

Attachment: FLushing_sync.png (image/png, text), 30.55 KiB.

[8 Sep 2023 13:58] Przemyslaw Malkowski
Graphs from 3 tests, LZ4, ZLIB and none

Attachment: PMM11.pdf (application/pdf, text), 584.71 KiB.

[8 Sep 2023 13:59] Przemyslaw Malkowski
Test details

Attachment: tests_mysqlslap_1.txt (text/plain), 7.95 KiB.

[8 Sep 2023 14:00] Przemyslaw Malkowski
insert script

Attachment: insert1.sql (application/sql, text), 88.97 KiB.

[14 Sep 2023 11:56] Przemyslaw Malkowski
Tests with page_cleaners=BP instances, and io_capacity at 10k; first run is no compression, second run LZ4 compression

Attachment: FLushing_none_vs_compression_high_iocapacity.png (image/png, text), 209.36 KiB.

[18 Oct 2023 12:07] Przemyslaw Malkowski
checkpoint graphs

Attachment: chkp_flushing.png (image/png, text), 58.01 KiB.

[18 Oct 2023 12:07] Przemyslaw Malkowski
CPU utilization during the same test

Attachment: CPU.png (image/png, text), 38.78 KiB.

[23 Oct 2023 13:58] Przemyslaw Malkowski
new examples with innodb_doublewrite_files tuning

Attachment: 2023-10-23_15-25.png (image/png, text), 88.90 KiB.

[23 Oct 2023 14:04] Przemyslaw Malkowski
innodb_doublewrite_files: 2, LZ4

Attachment: 8_0_34_lz4_dblwr-2.svg (image/svg+xml, text), 388.79 KiB.

[23 Oct 2023 14:06] Przemyslaw Malkowski
innodb_doublewrite_files: 16, LZ4

Attachment: 8_0_34_lz4_dblwr-16.svg (image/svg+xml, text), 365.56 KiB.

[23 Oct 2023 14:07] Przemyslaw Malkowski
innodb_doublewrite_files: 16, no compression

Attachment: 8_0_34_dblwr-16-nocompr.svg (image/svg+xml, text), 339.21 KiB.