Re: [boost] [testing] Proposal - regression tests results display upgrade

Subject: Re: [boost] [testing] Proposal - regression tests results display upgrade
From: Beman Dawes (bdawes_at_[hidden])
Date: 2014-05-28 09:56:20

On Wed, May 28, 2014 at 9:08 AM, Adam Wulkiewicz
<adam.wulkiewicz_at_[hidden]>wrote:

> Hi,
>
> Currently test failures of a new feature are always marked with the yellow
> color and a word 'fail'.
> Would it make sense to use some more descriptive color/naming scheme?
> In particular it would be nice to distinguish between the actual failures
> and the situations when the compilation of a test took too much time or an
> output file was too big.
> Would it make sense to also distinguish between compilation, linking and
> run failure? E.g. instead of a simple 'fail' use 'fail (c)', 'fail (l)' and
> 'fail (r)'.
> E.g. the color for actual failures could be orange and for "others" could
> stay yellow.
>
> Furthermore, currently it's impossible to see the results of compilation
> if a test passed.
> Would it make sense to change it?
> This would allow us to view and fix warnings even if the test was passed.
> The test passed with warnings could be marked e.g. with 'pass (w)' or the
> color could be set to some between yellow and this light green.
>

Makes sense to me. IIRC, Marshall Clow has given some thought to regression
test reporting needs, so you might want to get input from him.

>
> If you directed me where it should be done I could try to change it.
> I'm guessing it would require modifying some script generating the page
> and some CSS?
>

See boost-root\tools\regression\src\report

Thanks,

--Beman