[boost] regressions: release or not release?

From: Arkadiy Vertleyb (vertleyb_at_[hidden])
Date: 2006-02-06 13:59:43

Hi all.

There seem to exist certain inconsistency between which compilers are marked
as "required" in explicit-failures-markup.xml, and how often the regressions
are run on these compilers.  For example, for a long time there has been no
results for msvc or vc-7_0.  The cw-8_3 appeared in the regression tables
some time ago (adding 20 or so failures to the typeof test results), had the
regressions run a couple of times, and vanished (probably somebody removed
the old results).

This situation makes it very difficult to address the issues on these
compilers.  For example very few or no people on this list have cw-8_3
installed.  The "batch mode" (modifying the library or tests and waiting for
the next regression results) is almost not practical, since the regressions
on this compiler are run once a week or even less often.

Is there any other possibility that I am missing?

At the same time at least three parties run the regressions on vc7_1.  I
wonder if such resource utilization is wise...

I think regression testing is essential, and, ideally, should be run before
every commit.  I also understand that with Boost this is not feasible.  But
running regressions at least daily for every required compiler should be a
must, IMO.  If we can't achieve this for some compilers, this compilers
should be, I think, downgraded to "optional".

Regards,
Arkadiy