Bug #24033 Max_connections is reset when mysql-stress-test.pl is running to target server
Submitted: 7 Nov 2006 7:48 Modified: 21 Dec 2006 15:29
Reporter: Wing Lap Leung Email Updates:
Status: No Feedback Impact on me:
None 
Category:MySQL Server Severity:S2 (Serious)
Version:5.1.11 OS:Linux (Linux Fedora 5 Kernel 2.6.18)
Assigned to: CPU Architecture:Any
Tags: max_connection, stress-test

[7 Nov 2006 7:48] Wing Lap Leung
Description:
Interesting bug:
Target server runs MySQL 5.1.11 with config as follow:

[client]
#password       = your_password
port            = 3306
socket          = /tmp/mysql.sock

# Here follows entries for some specific programs

# The MySQL server
[mysqld]
port            = 3306
socket          = /tmp/mysql.sock
#skip-locking
skip-innodb
skip-bdb
#key_buffer = 384M
key_buffer = 1536M
max_allowed_packet = 16M
table_cache = 512
sort_buffer_size = 2M
join_buffer_size = 2M
read_buffer_size = 2M
read_rnd_buffer_size = 5M
myisam_sort_buffer_size = 64M
#thread_cache_size = 8
thread_cache_size = 5000
#query_cache_size = 32M
query_cache_size = 512M
# Try number of CPU's*2 for thread_concurrency
thread_concurrency = 8
#Added on 21/10/2006
skip-name-resolve
max_connections = 300
max_user_connections = 5000
max_connect_errors=500
back_log = 5000
log
log_error
expire_logs_days = 7
#In seconds
connect_timeout = 5

# Don't listen on a TCP/IP port at all. This can be a security enhancement,
# if all processes that need to connect to mysqld run on the same host.
# All interaction with mysqld must be made via Unix sockets or named pipes.
# Note that using this option without enabling named pipes on Windows
# (via the "enable-named-pipe" option) will render mysqld useless!
#
#skip-networking

# Replication Master Server (default)
# binary logging is required for replication
#log-bin=mysql-bin

# required unique id between 1 and 2^32 - 1
# defaults to 1 if master-host is not set
# but will not function as a master if omitted
server-id       = 1

# Replication Slave (comment out master section to use this)
#
# To configure this host as a replication slave, you can choose between
# two methods :
#
# 1) Use the CHANGE MASTER TO command (fully described in our manual) -
#    the syntax is:
#
#    CHANGE MASTER TO MASTER_HOST=<host>, MASTER_PORT=<port>,
#    MASTER_USER=<user>, MASTER_PASSWORD=<password> ;
#
#    where you replace <host>, <user>, <password> by quoted strings and
#    <port> by the master's port number (3306 by default).
#
#    Example:
#
#    CHANGE MASTER TO MASTER_HOST='125.564.12.1', MASTER_PORT=3306,
#    MASTER_USER='joe', MASTER_PASSWORD='secret';
#
# OR
#
# 2) Set the variables below. However, in case you choose this method, then
#    start replication for the first time (even unsuccessfully, for example
#    if you mistyped the password in master-password and the slave fails to
#    connect), the slave will create a master.info file, and any later
#    change in this file to the variables' values below will be ignored and
#    overridden by the content of the master.info file, unless you shutdown
#    the slave server, delete master.info and restart the slaver server.
#    For that reason, you may want to leave the lines below untouched
#    (commented) and instead use CHANGE MASTER TO (see above)
#
# required unique id between 2 and 2^32 - 1
# (and different from the master)
# defaults to 2 if master-host is set
# but will not function as a slave if omitted
#server-id       = 2
#
# The replication master for this slave - required
#master-host     =   <hostname>
#
# The username the slave will use for authentication when connecting
# to the master - required
#master-user     =   <username>
#
# The password the slave will authenticate with when connecting to
# the master - required
#master-password =   <password>
#
# The port the master is listening on.
# optional - defaults to 3306
#master-port     =  <port>
#
# binary logging - not required for slaves, but recommended
#log-bin=mysql-bin

# Point the following paths to different dedicated disks
#tmpdir         = /tmp/
#log-update     = /path-to-dedicated-directory/hostname

# Uncomment the following if you are using BDB tables
#bdb_cache_size = 384M
#bdb_max_lock = 100000

# Uncomment the following if you are using InnoDB tables
#innodb_data_home_dir = /usr/local/mysql/data/
#innodb_data_file_path = ibdata1:2000M;ibdata2:10M:autoextend
#innodb_log_group_home_dir = /usr/local/mysql/data/
#innodb_log_arch_dir = /usr/local/mysql/data/
# You can set .._buffer_pool_size up to 50 - 80 %
# of RAM but beware of setting memory usage too high
#innodb_buffer_pool_size = 384M
#innodb_additional_mem_pool_size = 20M
# Set .._log_file_size to 25 % of buffer pool size
#innodb_log_file_size = 100M
#innodb_log_buffer_size = 8M
#innodb_flush_log_at_trx_commit = 1
#innodb_lock_wait_timeout = 50

[mysqldump]
quick
max_allowed_packet = 16M

[mysql]
no-auto-rehash
# Remove the next comment character if you are not familiar with SQL
#safe-updates

[isamchk]
key_buffer = 256M
sort_buffer_size = 256M
read_buffer = 2M
write_buffer = 2M

[myisamchk]
key_buffer = 256M
sort_buffer_size = 256M
read_buffer = 2M
write_buffer = 2M

[mysqlhotcopy]
interactive-timeout
###########################################################################

There are other 2 physical machines.  All machines are running Linux Fedora 5 with Kernel 2.6.  

I got a mysql-stress-test.pl from Windows zipped source file and write a simple shell script to run the following perl command:

perl /root/mysql-stress-test.pl --stress-basedir=/root/mysqlstresstest --stress-suite-basedir=/usr/local/mysql/mysql-test/ --server-logs-dir=/usr/local/mysql/serverlog --stress-tests-file=/usr/local/mysql/mysql-test/stress-test.txt --mysqltest=/usr/local/mysql/bin/mysqltest --server-user=root --server-database=test --cleanup --verbose --test-duration=600 --server-host=192.168.0.110 --threads=230

All 2 servers will act as client machines to run this perl script against the MySQL Server, which IP is 192.168.0.110.

When 1 machines are running the test, I used mysqlreport, which is a perl script to monitor MySQL server, showing this:

__ Connections _________________________________________________________
Max used            xxx of  300      %Max:   xxxx
Total               xxx    xxxx/s

, which, is ok.

However, when another machine started the stress test process, the connections to target server dropped suddenly below 100:

__ Connections _________________________________________________________
Max used            xxx of  100      %Max:   xxxx
Total               xxx    xxxx/s

and this figure doesn't restore until target server is restarted.

How to repeat:
See description
[8 Nov 2006 10:39] Wing Lap Leung
Additional comment:

I found that when I run customer stress test script, which is only a bunch of insert/select statements, the max_connections system variable did not reset.

i.e., I guess one of the available stress tests will reset this variable.

Hope it helps.
[21 Nov 2006 15:29] Valeriy Kravchuk
Thank you for a problem report. Please, try to repeat with a newer version, 5.1.12, and inform about the results.
[22 Dec 2006 0:00] Bugs System
No feedback was provided for this bug for over a month, so it is
being suspended automatically. If you are able to provide the
information that was originally requested, please do so and change
the status of the bug back to "Open".