Bug #93532 Caused by error 7200: LCP fragment scan watchdog detected a problem
Submitted: 9 Dec 2018 21:18 Modified: 12 Dec 2018 21:06
Reporter: Howard Tong Email Updates:
Status: Can't repeat Impact on me:
None 
Category:MySQL Cluster: Disk Data Severity:S1 (Critical)
Version:7.5.8 OS:CentOS
Assigned to: MySQL Verification Team CPU Architecture:Any

[9 Dec 2018 21:18] Howard Tong 
Description:
Two nodes were forced shut down due to "LCP fragment scan watchdog detected a problem"

total 8 data nodes, node#9 and node#10 had problem and forced shut down. 

log files are attached. 

[ndbd default]
NoOfReplicas=2

DataMemory=192G
IndexMemory=32G

RedoBuffer=100M
RedoOverCommitLimit=30
Diskless=false

StringMemory=25
MaxNoOfTables=4096
MaxNoOfUniqueHashIndexes=512
MaxNoOfOrderedIndexes=2048
MaxNoOfAttributes=24576
MaxNoOfTriggers=14336

MaxNoOfExecutionThreads=72
NoOfFragmentLogParts=32

TransactionDeadlockDetectionTimeout=3000

FragmentLogFileSize=256M
InitFragmentLogFiles=SPARSE
NoOfFragmentLogFiles=100
MaxNoOfLocalOperations=2000000
MaxNoOfConcurrentOperations=1000000
MaxNoOfConcurrentTransactions=16384
TimeBetweenGlobalCheckpoints=1000
TimeBetweenEpochs=100
TimeBetweenEpochsTimeout=32000

TimeBetweenLocalCheckpoints=10

HeartbeatIntervalDbDb=15000
HeartbeatIntervalDbApi=15000

MemReportFrequency=180
BackupReportFrequency=180
LogLevelStartup=15
LogLevelShutdown=15
LogLevelCheckpoint=8
LogLevelNodeRestart=15

SharedGlobalMemory=512M
DiskPageBufferMemory=2G
BatchSizePerLocalScan=512

How to repeat:
cannot be repeated
[9 Dec 2018 21:22] Howard Tong 
mgm log

Attachment: ndb_1_cluster.log (application/octet-stream, text), 365.97 KiB.
[9 Dec 2018 21:22] Howard Tong 
data node log

Attachment: ndb_9_out.log (application/octet-stream, text), 758.33 KiB.
[9 Dec 2018 21:23] Howard Tong 
data node log

Attachment: ndb_9_error.log (application/octet-stream, text), 2.02 KiB.
[9 Dec 2018 21:23] Howard Tong 
data node log

Attachment: ndb_10_out.log (application/octet-stream, text), 760.29 KiB.
[9 Dec 2018 21:23] Howard Tong 
data node log

Attachment: ndb_10_error.log (application/octet-stream, text), 2.02 KiB.
[12 Dec 2018 21:06] MySQL Verification Team 
I am not able to reproduce the problem.