Re: [Boost-bugs] [Boost C++ Libraries] #12902: boost test labels

Subject: Re: [Boost-bugs] [Boost C++ Libraries] #12902: boost test labels
From: Boost C++ Libraries (noreply_at_[hidden])
Date: 2017-05-07 11:13:25

#12902: boost test labels
-------------------------------+---------------------
  Reporter:  dimitry           |      Owner:  rogeeff
      Type:  Support Requests  |     Status:  new
 Milestone:  To Be Determined  |  Component:  test
   Version:  Boost 1.63.0      |   Severity:  Problem
Resolution:                    |   Keywords:
-------------------------------+---------------------

Comment (by Moritz Pflanzer <moritz@…>):

 I also run into a problem with filtering test cases when labels are
 involved. For instance I have multiple test suites where each represents a
 specific feature that will be tested in the suite. Because some of the
 test cases actually take a long time to run I also added labels "quick"
 and "slow". The idea was to be able to run only the fast tests, or the
 slow tests, or all together.

 My test suite structure looks something like this:
 {{{
 F1*
     test1_at_slow
     test2_at_quick
 F2*
     test1_at_quick
     test2_at_slow
 }}}

 Selecting based on labels alone works well by specifying {{{--run_test
 '@slow'}}} etc. It would run the following tests:
 {{{
 F1*
     test1_at_slow
 F2*
     test2_at_slow
 }}}

 It also works if I want to exclude, for example, the slow tests for a
 specific feature (or a selected subset of the features): {{{--run_test
 'F1:!@slow'}}}

 {{{
 F1*
     test1_at_quick
 }}}

 However, if I only want to run the fast tests but exclude one feature
 ({{{--run_test '@quick:!F1'}}}) it doesn't work. It seems to be impossible
 to exclude test cases that have been enabled by a label. Though, according
 to the documentation "''the disabler takes the precedence over the
 enabler.''"
 {{{
 F1*
     test2_at_quick
 F2*
     test1_at_quick
 }}}

 Additionally it would be nice to express something like "Run test suite F1
 but only the tests labelled quick". I think currently that can only be
 achieved by negating all labels except for @quick. But if there are many
 labels it quickly becomes impractical.

-- 
Ticket URL: <https://svn.boost.org/trac/boost/ticket/12902#comment:3>
Boost C++ Libraries <http://www.boost.org/>
Boost provides free peer-reviewed portable C++ source libraries.