|
Boost Testing : |
Subject: Re: [Boost-testing] [Boost-build] meaning of "rev" in test report
From: Stefan Seefeld (stefan_at_[hidden])
Date: 2016-10-27 12:18:25
On 27.10.2016 11:46, Rene Rivera wrote:
> On Thu, Oct 27, 2016 at 10:37 AM, Stefan Seefeld <stefan_at_[hidden]
> <mailto:stefan_at_[hidden]>> wrote:
>
> the test report matrix reports a "rev" attribute for each test run,
> presumably showing a git SHA. However, I'm somewhat doubtful about
> what
> repository that is referring to. For example I'd expect the revs in
> http://www.boost.org/development/tests/develop/developer/python.html
> <http://www.boost.org/development/tests/develop/developer/python.html>
> to
> correspond to SHAs in the https://github.com/boostorg/python
> <https://github.com/boostorg/python> repo.
> However, I can't seem to find a single match, i.e. none of the SHAs I
> see in the matrix appears in my git log.
>
> If that's not the repo whose revision is being reported, which repo is
> being used ? And how can I map that to the revision of the module
> being
> tested (Boost.Python in this case) ?
>
> (The reason I'm asking is that now that the NumPy tests trickle in, I
> see a bunch of failures, but looking at the error I notice an issue I
> fixed a week (or so) ago, yet the test runs are more recent than
> that. I
> think it's crucial for the test report to give a clear indication
> of the
> tested module's SHA to make it possible to attempt to reproduce the
> tests locally.
>
>
> The main rev you see in the reports is the SHA of the superproject
> <https://github.com/boostorg/boost>. If you look at the info for each
> tester there's a list of each of the submodules with a SHA of the
> submodule version that was pulled in that superproject rev. For
> example in
> <http://www.boost.org/development/tests/develop/teeks99-09e-win2012R2-64on64.html>
> scroll down past the tester env info and you'll see a table of "Repo"
> and "Revision" entries like this:
>
> Repo Revision
> \boost_bb
>
> 154667bb312be0cb62c9642689c566606eb7ed05
> \boost_regression
>
> 35d42b5d50dff7008374807aa136ddf26a97a2fd
> \boost_root
>
> ee9cddd7ea9ada871bea6de6c116e41c83c4654a
> \boost_root\libs\accumulators
>
> 70ec4c602be9d014c7246eb8ce50a6cb81f45885
>
> The first entry if the Boost Build version used to drive the testing.
> The second is the regression tools used. The third is the same as the
> one reported in the main result pages (ie the superproject). And the
> rest are the ones for submodule.
>
> HTH.
It does indeed. :-)
Thanks !
Stefan
-- ...ich hab' noch einen Koffer in Berlin...