[boost] Regression testing Clang/LLVM with VC14.

Subject: [boost] Regression testing Clang/LLVM with VC14.
From: degski (degski_at_[hidden])
Date: 2016-04-09 01:32:28

I have started a new thread as the other one "Testing of clang emualting
the VC++ preprocessor on Windows" has become rather long and interlaced
with less relevant musings. Here I would like to concentrate on the subject
in the title.

Sergey suggested I'd run regression tests, in the "other thread". I was
hesitant at first, mostly due to the luke warm reception. Thanks to
Google's simple coding of their spam filter, I actually missed the post by
Niall Douglas of 4th of April. When it was referenced later and after I dug
it from the archives, I became encouraged by the fact that maybe I wasn't
all wrong and somebody within the community was actually thinking along
similar lines as me.

Following this I'd decided to take on regression testing. I chose to first
simply test boost-develop against VC14, just to see how it goes. Some good,
some bad. Was easy to set up (git already included with VC14, all what I
needed to do was install python, which I normally have, but I'm having a
new laptop). The bad, space required 44GB (advertised as 5GB). Possibly
.pdb files (debugger symbols) are filling up disk-space uselessly.  Next
bad, the process finished with the following lines:

# Done writing "C:\boost_develop\results\degski.xml".
# Compressing "C:\boost_develop\results\degski.xml"...
# Done writing "C:\boost_develop\results\degski.zip".
# Uploading log archive "C:\boost_develop\results\degski.zip" to develop
# <lambda> failed with message "[Errno 10013] An attempt was made to access
a socket in a way forbidden by its access permissions"
# Retrying (5 more attempts).
# Uploading log archive "C:\boost_develop\results\degski.zip" to develop
# <lambda> failed with message "[Errno 10013] An attempt was made to access
a socket in a way forbidden by its access permissions"
# Retrying (4 more attempts).
# Uploading log archive "C:\boost_develop\results\degski.zip" to develop
# <lambda> failed with message "[Errno 10013] An attempt was made to access
a socket in a way forbidden by its access permissions"
# Retrying (3 more attempts).
# Uploading log archive "C:\boost_develop\results\degski.zip" to develop
# <lambda> failed with message "[Errno 10013] An attempt was made to access
a socket in a way forbidden by its access permissions"
# Retrying (2 more attempts).
# Uploading log archive "C:\boost_develop\results\degski.zip" to develop
# <lambda> failed with message "[Errno 10013] An attempt was made to access
a socket in a way forbidden by its access permissions"
# Retrying (1 more attempts).
# Uploading log archive "C:\boost_develop\results\degski.zip" to develop
# <lambda> failed with message "[Errno 10013] An attempt was made to access
a socket in a way forbidden by its access permissions"
# Giving up.
Traceback (most recent call last):
  File "run.py", line 71, in <module>
    runner(root)
  File "C:\boost_develop\boost_regression_src\regression.py", line 287, in
__init__
    self.main()
  File "C:\boost_develop\boost_regression_src\regression.py", line 624, in
main
    getattr(self,action_m)()
  File "C:\boost_develop\boost_regression_src\regression.py", line 591, in
command_regression
    self.command_upload_logs()
  File "C:\boost_develop\boost_regression_src\regression.py", line 538, in
command_upload_logs
    lambda:
  File "C:\boost_develop\boost_regression_src\regression.py", line 663, in
retry
    return f()
  File "C:\boost_develop\boost_regression_src\regression.py", line 546, in
<lambda>
    self.dart_server )
  File "C:\boost_develop\boost_regression_src\collect_and_upload_logs.py",
line 430, in upload_logs
    upload_to_ftp( tag, logs_archive, ftp_proxy, debug_level, ftp_url )
  File "C:\boost_develop\boost_regression_src\collect_and_upload_logs.py",
line 256, in upload_to_ftp
    ftp = ftplib.FTP( ftp_site )
  File "C:\Python27\lib\ftplib.py", line 120, in __init__
    self.connect(host)
  File "C:\Python27\lib\ftplib.py", line 135, in connect
    self.sock = socket.create_connection((self.host, self.port),
self.timeout)
  File "C:\Python27\lib\socket.py", line 575, in create_connection
    raise err
socket.error: [Errno 10013] An attempt was made to access a socket in a way
forbidden by its access permissions

I've re-checked this page
<http://www.boost.org/development/running_regression_tests.html>again,
there's no mention of "registering" or something similar. Some tests must
have failed, got prompted for starting the debugger twice (is the latter
normal).

This was a test-run (testing the testing), with VC14U2. Assuming the above
can get sorted, I would in reality like to test Clang/LLVM (with VC14U2). I
would like to ask (Niall Douglas in particular, I guess) what the suggested
parameters to run.py should be for this combo. Should I target clang.exe or
clang-cl.exe, develop or master. What about Clang/C2? How to reduce
disk-space usage?

degski