Boost logo

Boost :

Subject: [boost] [contract] help marking regression test expected failures
From: Lorenzo Caminiti (lorcaminiti_at_[hidden])
Date: 2017-10-24 23:16:09


Hello all,

I need some help with marking some Boost.Contract regression tests as
expected failures.

I don't understand why my explicit-failures-markup.xml:
https://github.com/boostorg/boost/blob/develop/status/explicit-failures-markup.xml

Doesn't math the expected failures I see on the regression report:
http://www.boost.org/development/tests/develop/developer/contract.html

For example, the following from explicit-failures-markup.xml (around
line 887) should marked old-if_copyable test as an expected failure on
msvc-11.0:

        ...
        <mark-expected-failures>
            <test name="old-if_copyable"/>
            <test name="old-if_copyable_macro"/>
            <toolset name="gcc-gnu-4.7.2"/>
            <toolset name="gcc-gnu-4.7~c++11"/>
            <toolset name="gcc-mngw-gnu-4.6c+"/>
            <toolset name="gcc-mngw-gnu-4.7c+"/>
            <toolset name="msvc-10.0"/>
            <toolset name="msvc-11.0"/>
            <note author="Lorenzo Caminiti">
                Test fails because this complier version does not properly
                implement SFINAE causing incorrect errors on substituion
                failures for private and protected members (this seems to be
                fixed in GCC 4.8 and MSVC 12.0).
            </note>
        </mark-expected-failures>
        ...

But the old-if_copyable test still shows up as a failure on the
regression test report:

http://www.boost.org/development/tests/develop/developer/output/teeks99-08-d-win2012R2-64on64-boost-bin-v2-libs-contract-test-old-if_copyable-test-msvc-11-0-dbg-adrs-mdl-64-thrdp-wn32-thrd-mlt.html

Any idea what I am doing wrong?

Thank you.
--Lorenzo


Boost list run by bdawes at acm.org, gregod at cs.rpi.edu, cpdaniel at pacbell.net, john at johnmaddock.co.uk