Bug #86110 A number of MTR test cases fail when run on a server with no PERFSCHEMA
Submitted: 27 Apr 2017 12:49 Modified: 24 Oct 2018 8:47
Reporter: Yura Sorokin (OCA) Email Updates:
Status: Won't fix Impact on me:
None 
Category:MySQL Server: Tests Severity:S3 (Non-critical)
Version:5.6.36 OS:Any
Assigned to: CPU Architecture:Any

[27 Apr 2017 12:49] Yura Sorokin
Description:
The following MTR test cases fail when run on a 5.6 server compiled with '-DWITH_PERFSCHEMA_STORAGE_ENGINE=OFF' cmake option.

main.mysql_client_test
main.validate_password_plugin
perfschema.start_server_1_digest
sys_vars.pfs_max_digest_length_basic
funcs_1.processlist_priv_no_prot
funcs_1.processlist_val_no_prot
main.sp-threads

The same problem may exist on 5.5, 5.7 and 8.0 as well.

How to repeat:
cmake \
 ../mysql-server \
 -DCMAKE_BUILD_TYPE=Debug \
 -DBUILD_CONFIG=mysql_release \
 -DFEATURE_SET=community \
 -DMYSQL_MAINTAINER_MODE=ON \
 -DENABLE_DTRACE=OFF \
 -DWITH_EXAMPLE_STORAGE_ENGINE=ON \
 -DWITH_PERFSCHEMA_STORAGE_ENGINE=OFF \
 -DWITH_SSL=system \
 -DENABLE_DOWNLOADS=1

./mysql-test/mtr \
  --parallel=4 \
  --result-file \
  --debug-server \
  --force \
  --max-test-fail=0 \
  --suite-timeout=10000 \
  --unit-tests \
  --testcase-timeout=450 | tee mtr.log

Suggested fix:
This happens either because these tests use queries to 'performance_schema.*' and do not have '--source include/have_perfschema.inc' or they produce different results with and without '-DWITH_PERFSCHEMA_STORAGE_ENGINE=OFF'.
[27 Apr 2017 13:55] MySQL Verification Team
Hello Yura Sorokin,

Thank you for the report.

Thanks,
Umesh
[24 Oct 2018 8:47] Erlend Dahl
We are sorry, but we will not fix this. Performance schema is part of the default build, and we don't have the time or the resources to tweak the testsuite to run with non-default setups.