Re: [Boost-testing] [RudbekAssociates][Martin Wille] Removed tests still showing up in regression results

From: Rene Rivera (grafikrobot_at_[hidden])
Date: 2006-07-04 12:31:51

Andreas Huber wrote:
> Rene Rivera wrote:
>> Andreas Huber wrote:
>>> Hi there
>>>
>>> As can be seen in the current branch regression results ...
>>>
>>> http://engineering.meta-comm.com/boost-regression/CVS-RC_1_34_0/developer/statechart.html,
>>>
>>> ... tests InvalidTransitionTest3* & InvalidTransitionTest4*, which
>>> have been removed two weeks ago still show up in the fairly current
>>> regression results of ...
>>>
>>> RudbekAssociates-V2
>>> Martin Wille V2
>>> Martin Wille x86_64 V2
>>>
>>> I've verified that the zip file uploaded by RudbekAssociates actually
>>> contains results for these tests so a problem in the metacomm report
>>> generator can be ruled out.
>>> Any ideas how this can happen?
>> Easily, if the testers in question don't clear out the regression
>> results for each run.
> 
> Ok. Um, for non-incremental runs, is there any advantage when the 
> results are not cleared with before every test run?

If they happen to be using a common output directory they can collect 
results from independent runs without having previous results disappear.

-- 
-- Grafik - Don't Assume Anything
-- Redshift Software, Inc. - http://redshift-software.com
-- rrivera/acm.org - grafik/redshift-software.com
-- 102708583/icq - grafikrobot/aim - grafikrobot/yahoo