Re: [boost] Rapid turnaround testing

From: David Abrahams (dave_at_[hidden])
Date: 2007-10-16 14:48:52

on Thu Oct 04 2007, Beman Dawes <bdawes-AT-acm.org> wrote:

> As an experiment, I've got a script that is checking svn every 15 
> minutes, and if there is a change, running the regression tests and 
> uploading results to a web site.
>
> For current VC++ results, see 
> http://mysite.verizon.net/beman/win32-trunk-results.html
> On these runs the reporting is set to show a row only if the results are 
> something other than a simple "pass" without link.

That part doesn't seem to be working.

> For slightly outdated Linux results, see 
> http://mysite.verizon.net/beman/ubuntu-trunk-results.html
> Here the results show all tests, regardless of result.
>
> The idea is to supplement the regular regression tests at 
> http://beta.boost.org/development/tests/trunk/developer/serialization.html 
> with rapid turnaround tests on a few major platforms, aimed at giving 
> developers quick response as they try to fix bugs affecting platforms 
> they don't have access to. At the current level failures, the Win32 
> tests are turning around in 11 minutes while the Linux tests turn in 4 
> minutes. Thus worst case developers can see test results in 26 minutes!
>
> It seems to me this might be helpful to developers. Opinions?

I don't know.  This seems to use some older regression reporting
scripts; do they take into account explicit failure markup?

-- 
Dave Abrahams
Boost Consulting
http://www.boost-consulting.com