Re: [boost] [Report] 35 regressions on RC_1_34_0 (2007-03-12)

From: Thomas Witt (witt_at_[hidden])
Date: 2007-03-14 19:45:43

Stefan,

Stefan Seefeld wrote:
> 
> A fix went in over a week ago. Instead of having a row of results in the test matrix showing me
> 24 hours later whether all is well now, results are (for a number of reasons) tickling in one
> at a time.

While turnaround times like ours are not desirable I can't see why they 
make the whole system unreliable/unusable.

> Also, looking at the above descriptors, there are multiple entries for a number of
> toolkits, suggesting the number of failures reported is only barely correlated to the
> actual failures (and quite likely doesn't correspond the the current state of affairs) either.

This again is more a problem of what you read into the numbers than it's 
a problem with the numbers not being correct. Interestingly zero does 
not have this issues with interpretation.

> Thus my question: does anybody actually care about these numbers ?

Let me put it this way. I do because they are the only numbers we got.

Don't get me wrong these are all valid point with respect to usability. 
They just don't prove that the system is broken.

Thomas

-- 
Thomas Witt
witt_at_[hidden]