Re: [boost] Test reporting (Was: Process discussions)

Subject: Re: [boost] Test reporting (Was: Process discussions)
From: Steven Watanabe (watanabesj_at_[hidden])
Date: 2011-01-31 12:01:55

AMDG

On 1/31/2011 8:40 AM, Vladimir Prus wrote:
> Steven Watanabe wrote:
>> On 1/31/2011 5:12 AM, Daniel James wrote:
>>> On 31 January 2011 10:10, John Maddock<boost.regex_at_[hidden]>   wrote:
>>>>
>>>> * The testers machine builds it's own test results pages - ideally these
>>>> should go into some form of version control as well so we can roll back and
>>>> see what broke when.
>>>> * When a tester first starts testing they would add a short meta-description
>>>> to a script, and run the script to generate the test results index pages. ie
>>>> there would be no need for a separate machine collecting and processing the
>>>> results.
>>>> * The test script should run much of the above *in parallel* if requested.
>>>
>>> Is anyone willing to work on something like this? Everyone seems a bit
>>> scared of the testing scripts, although I thnk Rene is working on a
>>> new reporting system.
>>>
>>
>> I suspect that this is largely a matter of
>> unfamiliarity.  I translated most of the
>> report generation xsl scripts into C++ last
>> year, and I didn't find them that hard to
>> understand.
>
> Oh -- but are we still using XSLT? Do you think we can
> easily switch to your C++ translation?
>

It would take more work to get it into a usable
state.  The existing tools are a combination of
xslt and python, and I significantly restructured
the way the xsl part works, because the limitations
of xsl forced them to do a number of things that
didn't make a lot of sense when using a real
language.  I was working on integrating everything
into a single executable, but I never finished.

Since Rene is also working on a rewrite, I don't
know that finishing this would be worth the effort.
 From a performance standpoint, the main bottleneck
seemed to be writing out so many small files.
Writing directly to a zip archive improved the
performance by an order of magnitude.

In Christ,
Steven Watanabe