Bug #46886 Make the cluster regression performance testing more stable
Submitted: 24 Aug 12:44 Modified: 8 Oct 9:31
Reporter: Jørgen Austvik
Status: Open
Category:Tests: Cluster Severity:S3 (Non-critical)
Version: OS:Any
Assigned to: Jørgen Austvik Target Version:

[24 Aug 12:44] Jørgen Austvik 
Description:
Today the cluster performance regression testing gives throughput numbers that vary a
lot.

It must be changed so that the numbers are stable.

The reason could be related to that we are running the regression performance tests with
the compile hosts as the drivers (because of ACRT limitations).

How to repeat:
Run ACRT performance regression tests
[7 Sep 14:14] Sveta Smirnova 
Thank you for the report.

Please provide link to exact results showing the problem.
[8 Oct 1:00] Bugs System 
No feedback was provided for this bug for over a month, so it is
being suspended automatically. If you are able to provide the
information that was originally requested, please do so and change
the status of the bug back to "Open".
[8 Oct 9:31] Jørgen Austvik 
Deviation percentage(s) for run.

Threads      %
-------   ------
4         -23.8710971253866
8         -36.7424580852177
12         -35.8359136696331
16         -47.7675966804941
20         -55.1490323675231
24         -60.7918021720785

Deviation percentage(s) for run.

Threads      %
-------   ------
4         32.9482974911101
8         58.0285579838931
12         56.1629047254796
16         91.2127781086904
20         125.240762840127
24         155.466606003414