Re: [Boost-testing] Understanding and customizing Boost Regression Tests HTML reports by Boost.Build logs processing tools (compiler_status and proccess_jam_log)

From: Voronkov Konstantin (beowinkle_at_[hidden])
Date: 2005-08-01 03:04:14

Thanks for you answer, Beman!

 >>Also there is column Test Type which sometimes is empty
 >> and sometimes is "unknown". Why test type can be unknown
 > Basically, compiler_status was designed for Boost use,
 > and no thought was given to customization for other

Beman, but I have "unknown" Test Type even if I
  run bjam from BOOST_ROOT\status. Is it ok?
E.g. I have next records in HTML result table:

abi_test  | unknown | Pass
access    | unknown | Pass

Best Regards,
Konstantin

Beman Dawes wrote:
> "Voronkov Konstantin" <beowinkle_at_[hidden]> wrote in message 
> news:dcd67k$1d7$1_at_sea.gmane.org...
> 
> 
>>I'm going to perform regression tests in our company
>> using Boost Regression Tests framework. I have few
>>questions about customization of HTML reports.
>>
>>
>>1. There is table which contains records for each test.
>> The table contains Library column which sometimes is
>>filled and sometimes is not. What is affected the fill
>>of the column?
>>Also there is column Test Type which sometimes is empty
>> and sometimes is "unknown". Why test type can be unknown
>>or empty? I expect test type contain one of "run, run-fail,
>>link, link-fail, and compile, compile-fail values.
>>How can I fix that the column is always filled?
>>
>>
>>2. Each row in table with tests has next view:
>><tr>
>> <td>
>>  <a href="http://cvs.sourceforge.net/viewcvs.py/boost/boost/libs/">
>>  </a>
>> </td>
>> <td>
>>  <a
>>href="http://cvs.sourceforge.net/viewcvs.py/*checkout*/boost/boost/?view=markup&rev=HEAD">
>>autoRegTestsSample
>>  </a>
>> </td>
>> <td></td>
>> <td>
>>  <a href="cs-win32-links.html#-autoRegTestsSample-vc7">
>>   <font color="#FF0000"><i>Fail</i></font>
>>  </a>
>> </td>
>></tr>
>>
>>Can how to customize the links to cvs.sourcefourge.net to point
>> somewhere to our place? Is is possible that Boost Regression
>>Tests automatically fills the target with content? Is there
>>any documentation at this point?
>>
>>
>>3. There are few built-in links. E.g. for msvc toolset
>> it proposes to re-direct to msdn.microsoft.com site,
>>the tests explanations are located at address:
>>compiler_status.html#test-type, the picture is
>>located in ../boost.png.
>>Can those links be customized?
> 
> 
> Basically, compiler_status was designed for Boost use, and no thought was 
> given to customization for other organizations.
> 
> If you wanted to tackle a redesign, I'm sure other Boosters would appreciate 
> it.
> 
> One approach would be to read in a parameter file (XML format?) which 
> provided strings for all the customization points.
> 
> HTH,
> 
> --Beman