Boost logo

Boost :

Subject: Re: [boost] [testing] Proposal - regression tests results display upgrade
From: Beman Dawes (bdawes_at_[hidden])
Date: 2014-05-28 09:56:20

On Wed, May 28, 2014 at 9:08 AM, Adam Wulkiewicz

> Hi,
> Currently test failures of a new feature are always marked with the yellow
> color and a word 'fail'.
> Would it make sense to use some more descriptive color/naming scheme?
> In particular it would be nice to distinguish between the actual failures
> and the situations when the compilation of a test took too much time or an
> output file was too big.
> Would it make sense to also distinguish between compilation, linking and
> run failure? E.g. instead of a simple 'fail' use 'fail (c)', 'fail (l)' and
> 'fail (r)'.
> E.g. the color for actual failures could be orange and for "others" could
> stay yellow.
> Furthermore, currently it's impossible to see the results of compilation
> if a test passed.
> Would it make sense to change it?
> This would allow us to view and fix warnings even if the test was passed.
> The test passed with warnings could be marked e.g. with 'pass (w)' or the
> color could be set to some between yellow and this light green.

Makes sense to me. IIRC, Marshall Clow has given some thought to regression
test reporting needs, so you might want to get input from him.

> If you directed me where it should be done I could try to change it.
> I'm guessing it would require modifying some script generating the page
> and some CSS?

See boost-root\tools\regression\src\report



Boost list run by bdawes at, gregod at, cpdaniel at, john at