Re: [boost] Regression matrix stopped updating

Subject: Re: [boost] Regression matrix stopped updating
From: Tom Kent (lists_at_[hidden])
Date: 2019-01-05 04:01:03

On Fri, Jan 4, 2019 at 8:25 PM Tom Kent <lists_at_[hidden]> wrote:

>
>
> On Fri, Jan 4, 2019 at 7:13 AM Rene Rivera <grafikrobot_at_[hidden]> wrote:
>
>> On Fri, Jan 4, 2019 at 7:07 AM Tom Kent via Boost <boost_at_[hidden]>
>> wrote:
>>
>>> On Tue, Dec 18, 2018 at 10:37 AM Nikita Kniazev via Boost <
>>> boost_at_[hidden]> wrote:
>>>
>>> > For past month or two regression matrix update frequency was
>>> fluctuating in
>>> > a big range, sometimes not updating for two-three days. As for now
>>> master
>>> > is not updated for 7 days and develop for 5 days.
>>> >
>>> > https://www.boost.org/development/tests/master/developer/summary.html
>>> > Summary: Master
>>> > Report Time: Tue, 11 Dec 2018 01:44:54 +0000
>>> >
>>> > https://www.boost.org/development/tests/develop/developer/summary.html
>>> > Summary: Develop
>>> > Report Time: Thu, 13 Dec 2018 06:05:04 +0000
>>> >
>>> > Is it down for maintenance or what is going on?
>>> >
>>>
>>> It seems that the master results have stalled again (Since Dec 26.) also,
>>> develop just ran yesterday but may also be stalled. It used to run every
>>> hour and hasn't run for several.
>>>
>>> Is there a public job I can look at somewhere (Travis?) to see the status
>>> of these? I'm guessing the job is based off of the Regression repo, but
>>> I'm
>>> not sure which directory in there does what. I believe "testing" is what
>>> the clients running tests use, can someone explain what the "reports",
>>> "library_status", and "ci/src" directories are for?
>>>
>>
>> https://github.com/boostorg/regression/tree/ci/test-reports
>>
>>
> Is there a way to see the CircleCI outputs? Can we put a badge up for
> pass/fail?  I couldn't find a way to navigate/search to the boostorg stuff
> on CircleCI, maybe I'm missing something?
>

Nevermind, I was able to find the results:
https://circleci.com/gh/boostorg/regression/tree/ci%2Ftest-reports

It looks like there were a few very large result sets that were about 130MB
gumming things up. It was taking more than 10min for that single file to
download from the results ftp server to CircleCI, which caused it to
timeout when no status was presented for those 10 min. A typical result set
is just a few MB and these were from early december, so I deleted them from
the server and that seems to have gotten things going again.

In general, I wonder if CircleCI is throtteling us or something, develop
only has 650MB of files (now) and it still took 25min to download all of
them! Not sure how to debug that.

I've also made a pull request that prints out a dot every 100KB of FTP
transfer, so that should keep CircleCI happy if this happens again in the
future:
https://github.com/boostorg/regression/pull/50

Tom