Bug #56787 MTR completion report should include number of skipped tests
Submitted: 15 Sep 2010 8:23 Modified: 14 Nov 2010 2:50
Reporter: Roy Lyseng Email Updates:
Status: Closed Impact on me:
None 
Category:Tools: MTR / mysql-test-run Severity:S4 (Feature request)
Version: OS:Any
Assigned to: Bjørn Munch CPU Architecture:Any

[15 Sep 2010 8:23] Roy Lyseng
Description:
I think that the completion report for MTR should include number of skipped tests and look something like this:

Completed: 493 successful tests, 60 skipped tests, 5 failed tests

The reason for this change request is that recently we had a merge regression that suddenly made a lot more tests being skipped. When MTR completion reports "All NNN tests were successful", it is easy to overlook that the number of skipped tests suddenly increased after the last MTR run. Reporting the number of skipped tests would help a bit.

Besides, it is always useful to see the number of skipped tests, for whatever reason...

How to repeat:
Run MTR to completion with any suite.

Suggested fix:
Change completion report as indicated in description.
[15 Sep 2010 8:27] Bjørn Munch
Verified by looking at any MTR report.
[16 Sep 2010 8:41] Bugs System
A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/commits/118347

3088 Bjorn Munch	2010-09-16
      Bug #56787 MTR completion report should be more informative
      Added counts of skipped test, inclusing how many by test itself
      Also fixed misspelling in the (hitherto unused) variable name
[20 Sep 2010 8:13] Bugs System
A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/commits/118565

3090 Bjorn Munch	2010-09-20
      Bug #56787 MTR completion report should be more informative
      Added counts of skipped test, inclusing how many by test itself
      Also fixed misspelling in the (hitherto unused) variable name
[20 Sep 2010 9:24] Bjørn Munch
Pushed to 5.5-mtr, trunk-mtr and next-mr-mtr
[7 Oct 2010 22:59] Paul DuBois
Changes to test suite. No changelog entry needed.
[9 Nov 2010 19:48] Bugs System
Pushed into mysql-5.5 5.5.7-rc (revid:sunanda.menon@sun.com-20101109182959-otkxq8vo2dcd13la) (version source revid:sunanda.menon@sun.com-20101109182959-otkxq8vo2dcd13la) (merge vers: 5.5.7-rc) (pib:21)
[13 Nov 2010 16:09] Bugs System
Pushed into mysql-trunk 5.6.99-m5 (revid:alexander.nozdrin@oracle.com-20101113155825-czmva9kg4n31anmu) (version source revid:alexander.nozdrin@oracle.com-20101113152450-2zzcm50e7i4j35v7) (merge vers: 5.6.1-m4) (pib:21)
[13 Nov 2010 16:39] Bugs System
Pushed into mysql-next-mr (revid:alexander.nozdrin@oracle.com-20101113160336-atmtmfb3mzm4pz4i) (version source revid:vasil.dimov@oracle.com-20100629074804-359l9m9gniauxr94) (pib:21)