Re: [boost] [1.47.0] Regression test failures

Subject: Re: [boost] [1.47.0] Regression test failures
From: Beman Dawes (bdawes_at_[hidden])
Date: 2011-06-29 10:10:07

On Wed, Jun 29, 2011 at 8:21 AM, Thomas Heller
<thom.heller_at_[hidden]> wrote:
> On Wednesday, June 29, 2011 07:37:30 AM Beman Dawes wrote:
>> The following libraries are failing release regression tests on most
>> or all platforms:
>>
>> accumulators
>> build
>> config
>> spirit/repository
>> spirit/test
>
> After having a look at the spirit/test overview, there are some tests failing
> when using Phoenix V3, this is not really a release blocker as Phoenix V2 will
> be the default for this release. The plan was to iron out the bumps of spirit
> + Phoenix V3 during this release cycle.

Neither the release managers nor ordinary users can possibly know for
each library what issues are being worked on, what tests are expected
to fail, or whether a problem is serious or simply cosmetic. We have
to rely on the test results as displayed. And when a release is
showing many failures, it doesn't look ready for prime time.

So, please, do something:

*  Fix the underlying problem, or

*  Apply markup to indicate the test is expected to fail, or

*  Change the test itself to be more selective about the results it reports.

I don't meant to pick on any one library and will send more or less
the same reply to similar queries about other libraries.

--Beman