MySQL Bugs: #44979: Enhance MTR --experimental to support platform qualifier

Bug #44979	Enhance MTR --experimental to support platform qualifier
Submitted:	20 May 2009 9:49	Modified:	20 Dec 2009 0:44
Reporter:	Lars Heill	Email Updates:
Status:	Closed	Impact on me:	None
Category:	Tools: MTR / mysql-test-run	Severity:	S4 (Feature request)
Version:		OS:	Any
Assigned to:	Bjørn Munch	CPU Architecture:	Any

Description:
Please extend MTR's --experimental feature to support a format like

    <test name> [!]<platform>

or similar to mark the test as "exp-fail" when it fails on that platform.
Prefixing the platform name with "!" means the test is not marked "exp-fail" (just "fail") when failing on that platform.

<platform> could also be a list of platforms.

See also Bug#42888 and Bug#42988.

How to repeat:
N/A

Note: specification of <platform> beyond the base operating system name level (e.g windows, linux, solaris) is not requested here.

Just an example of a complicated situation which 
most probably must be handled:
1. Any MySQL binary generated from one source tree
   contains the same information how to handle
   (experimental, disabling, under which conditions,
   ...) some test independent of the compile OS
   Example: Release for Solaris ... for SUN SPARC
            contains how to handle some test on
            Windows
2. Assume a mysql binary compiled on Win32
3. OS of testing box  Outcome of test
   Win32              Success
   Win64              Failure
So some more specific information about the OS
(Win32,Win64,maybe more like XP and Vista)
and a distinction between OS used for compile
and OS used for testing might be required.

A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/commits/80754

2816 Bjorn Munch	2009-08-13
      Bug #44979 Enhance MTR --experimental to support platform qualifier
      Adding @<platform> syntax

A patch for this bug has been committed. After review, it may
be pushed to the relevant source trees for release in the next
version. You can access the patch from:

  http://lists.mysql.com/commits/80757

2816 Bjorn Munch	2009-08-13
      Bug #44979 Enhance MTR --experimental to support platform qualifier
      Adding @<platform> syntax

Seems to agree with the general approach of "experimental".

Pushed to 5.1-mtr and azalea-mtr

Pushed into 5.1.40 (revid:bjorn.munch@sun.com-20090903170735-679d64zp580wl39j) (version source revid:bjorn.munch@sun.com-20090903170735-679d64zp580wl39j) (merge vers: 5.1.40) (pib:11)

Test suite change. No changelog entry needed.

Pushed into 6.0.14-alpha (revid:alik@sun.com-20090929093622-1mooerbh12e97zux) (version source revid:alik@sun.com-20090922182109-vs5ign07cwht12z6) (merge vers: 6.0.14-alpha) (pib:11)

Pushed into 5.4.5-beta (revid:alik@sun.com-20090925094254-tjl9eajkzwzgthoe) (version source revid:alik@sun.com-20090922142453-x275o41whpyezh4q) (merge vers: 5.4.4-beta) (pib:11)

Pushed into 5.1.41-ndb-7.1.0 (revid:jonas@mysql.com-20091218102229-64tk47xonu3dv6r6) (version source revid:jonas@mysql.com-20091218095730-26gwjidfsdw45dto) (merge vers: 5.1.41-ndb-7.1.0) (pib:15)

Pushed into 5.1.41-ndb-6.2.19 (revid:jonas@mysql.com-20091218100224-vtzr0fahhsuhjsmt) (version source revid:jonas@mysql.com-20091217101452-qwzyaig50w74xmye) (merge vers: 5.1.41-ndb-6.2.19) (pib:15)

Pushed into 5.1.41-ndb-6.3.31 (revid:jonas@mysql.com-20091218100616-75d9tek96o6ob6k0) (version source revid:jonas@mysql.com-20091217154335-290no45qdins5bwo) (merge vers: 5.1.41-ndb-6.3.31) (pib:15)

Pushed into 5.1.41-ndb-7.0.11 (revid:jonas@mysql.com-20091218101303-ga32mrnr15jsa606) (version source revid:jonas@mysql.com-20091218064304-ezreonykd9f4kelk) (merge vers: 5.1.41-ndb-7.0.11) (pib:15)