[Boost-bugs] [Boost C++ Libraries] #8591: Incremental test runs do not detect test removal or configuration changes

Subject: [Boost-bugs] [Boost C++ Libraries] #8591: Incremental test runs do not detect test removal or configuration changes
From: Boost C++ Libraries (noreply_at_[hidden])
Date: 2013-05-19 07:40:34

#8591: Incremental test runs do not detect test removal or configuration changes
-------------------------------------+--------------------------------------
 Reporter:  andysem                  |       Owner:  grafik            
     Type:  Bugs                     |      Status:  new               
Milestone:  To Be Determined         |   Component:  Regression Testing
  Version:  Boost Development Trunk  |    Severity:  Problem           
 Keywords:                           |  
-------------------------------------+--------------------------------------
 There are two problems that can be seen on
 [http://www.boost.org/development/tests/trunk/developer/log.html this]
 page that stem from the same source:

 1. The util_dynamic_type_dispatcher and util_static_type_dispatcher tests
 were renamed to util_dynamic_type_disp and util_static_type_disp in SVN,
 but they are still present in the test matrix for incremental runners.

 2. The RDC-VC10 test runner shows test failures that correspond to an
 older revision than the tests were reportedly run. When clicking on the
 failed tests it can be seen that there are several test variants and the
 failed one should not be built according to the current library
 configuration.

 I believe both problems are because incremental test runs don't detect
 that a certain test or configuration no longer exist (or run) and re-
 collect the outdated results into the test matrix.

-- 
Ticket URL: <https://svn.boost.org/trac/boost/ticket/8591>
Boost C++ Libraries <http://www.boost.org/>
Boost provides free peer-reviewed portable C++ source libraries.