Re: [boost] Re: [1.33.0] Let's start preparations...

From: Douglas Gregor (doug.gregor_at_[hidden])
Date: 2005-03-08 14:16:36

On Mar 8, 2005, at 4:52 PM, Martin Wille wrote:
> Aleksey Gurtovoy wrote:
>> Martin Wille writes:
>>> - the testing procedure is complex
>> Internally, yes. The main complexity and _the_ source of fragility
>> lies in "bjam results to XML" stage of processing. I'd say it's one of
>> the top 10 issues by solving which we can substantially simplify
>> everybody's life.
>
> I agree. This processing step has to deal with the build system (which 
> in complex itself) and with different compiler output. Other 
> complexity probably stems from having to collect and to display test 
> results that reflect different cvs checkout times.

To improve the reproducibility of results and make testing more 
predictable, we might want to have the regression scripts always check 
out using a given date/time tag, e.g., 12:00am EST each night. That 
way, all of the tests for the day will be on the same codfe. If it 
helps fix other problems with regression testing, great!

        Doug