Re: [boost] marking regression test failures as expected

Subject: Re: [boost] marking regression test failures as expected
From: Andrzej Krzemienski (akrzemi1_at_[hidden])
Date: 2014-05-06 09:38:59

2014-04-30 12:05 GMT+02:00 Daniel James <dnljms_at_[hidden]>:

> On 30 April 2014 10:57, Andrzej Krzemienski <akrzemi1_at_[hidden]> wrote:
> > Hi,
> > I noticed in the regression tests results taht some failing tests are
> > marked as "fail*" in greyish color indicating that the failure is
> expected
> > along with the explanation why. E.g.,
> >
> http://www.boost.org/development/tests/develop/developer/output/teeks99-03a-Ubuntu12-04-64-boost-bin-v2-libs-optional-test-optional_test_ref-test-gcc-4-4-debug.html
> >
> > Question: how can I indicate that the new failure is expected in the same
> > manner?
>
> It's specified in the super project at
> 'status/explicit-failures-markup.xml'. I think you'll need to create a
> pull request.
>

I am trying to learn the syntax of this file and I cannot understand one
thing. When I look at tests results here:
http://www.boost.org/development/tests/master/developer/optional.html,
one test case (optional_test_ref<https://github.com/boostorg/optional/blob/master/test/optional_test_ref.cpp>)
is marked as expected failure for toolset "gcc- 4.4", but in the file
'status/explicit-failures-markup.xml'
I cannot find a corresponding entry for this toolset. How does the testing
framework know, then?

Regards,
&rzej