Boost Users :
Subject: Re: [Boost-users] [Test] Problem with expected failures in test suite
From: Gennadiy Rozental (rogeeff_at_[hidden])
Date: 2010-06-21 01:56:23
Maria Kozinska wrote:
> Thanks for answer.
> On 4 June 2010 00:27, Steven Watanabe <watanabesj_at_[hidden]> wrote:
>> Maria Kozinska wrote:
>>> I tried to write a test suite with one expected failure, however it is
>>> not working.
Apparently expected failures do not work with test suites properly. The
issue is that the reporting function validate both expected failures AND
failed test cases within the test unit. In your case at least one test
case will always fail and we do not have option to tell that one test
case is expected to fail.
I guess I can skip test case check, but in this case you may get into
the weird false positives with test suite passing when you actually it
expected to fail. For example you expected 2 failures in 1 test case,
but you got them in 2 different test cases.
Another option is to treat "expected failures" for test suite as
expected number of failed test cases, but this really changes semantic
thus is not backward compatible change. Not sure if anyone uses current
semantic (though it's obviously broken and never worked from what I can
>>> The idea is that I have a function that can be implemented in few
>>> ways, thus there are few possible correct results. Depending on the
>>> implementation, I want to test it with different set of test cases. I
>>> don't want to check at the beginning of each test case which option is
>>> valid, I would prefer to skip unnecessary test cases. Is it possible?
>> In init_unit_test_suite, can you try only adding the test
>> cases that you need?
> I have to add all of them, because at compile time I don't know yet
> which ones should be executed. It is ensured at runtime by
> dependencies - as with test1_1, which is executed only if option1
> succeeded (and skipped otherwise).
Why don't you put everything in a single test case and switch based on
the value of xxx to do one set of tests or another?
Boost-users list run by williamkempf at hotmail.com, kalb at libertysoft.com, bjorn.karlsson at readsoft.com, gregod at cs.rpi.edu, wekempf at cox.net