Re: [boost] [EXTERNAL] Re: raw.github.com access from behind firewall

Subject: Re: [boost] [EXTERNAL] Re: raw.github.com access from behind firewall
From: Belcourt, Kenneth (kbelco_at_[hidden])
Date: 2014-01-22 18:35:19

On Jan 22, 2014, at 3:55 PM, Thomas Suckow wrote:

>>> The valid URL in question is:
>>> https://raw.github.com/boostorg/boost/develop/tools/regression/src/regression.py
>>> 
>>> Which gives the "raw" data of the file.. Not the web page showing the fancy
>>> source code.
>> Here's the wget details in case it helps (with proxy).
>> 
>> -bash-4.1$ wget http://raw.github.com/boostorg/boost/develop/tools/regression/src/regression.py
>> --2014-01-22 15:09:29--  http://raw.github.com/boostorg/boost/develop/tools/regression/src/regression.py
>> Resolving wwwproxy.sandia.gov... 134.253.26.250
>> Connecting to wwwproxy.sandia.gov|134.253.26.250|:80... connected.
>> Proxy request sent, awaiting response... 301 Moved Permanently
>> Location: https://raw.github.com/boostorg/boost/develop/tools/regression/src/regression.py [following]
>> --2014-01-22 15:09:30--  https://raw.github.com/boostorg/boost/develop/tools/regression/src/regression.py
>> Resolving raw.github.com... 199.27.77.133
>> Connecting to raw.github.com|199.27.77.133|:443... failed: Connection timed out.
>> 
>> 
> Make sure that https_proxy is set to the same value as http_proxy. I believe that wget is attempting to bypass the proxy for secure connections.

Ah indeed, that was my wget problem.  So wget can download regression.py:

-bash-4.1$ wget https://raw.github.com/boostorg/boost/develop/tools/regression/src/regression.py
--2014-01-22 16:31:39--  https://raw.github.com/boostorg/boost/develop/tools/regression/src/regression.py
Resolving wwwproxy.sandia.gov... 134.253.26.250
Connecting to wwwproxy.sandia.gov|134.253.26.250|:80... connected.
Proxy request sent, awaiting response... 200 OK
Length: 41541 (41K) [text/plain]
Saving to: “regression.py”

100%[=========================================================================>] 41,541      --.-K/s   in 0.09s   

2014-01-22 16:31:40 (466 KB/s) - “regression.py” saved [41541/41541]

But run.py still hangs here:

-bash-4.1$ python run.py --tag=develop --runner="Sandia-Linux" --bjam-options="-j16" --proxy=http://wwwproxy.sandia.gov:80 
# Running regressions in /scratch/modular-boost...
# Creating regression scripts at /scratch/modular-boost/tools_regression_src...
# Downloading regression scripts from https://raw.github.com/boostorg/boost/develop/tools/regression/src...
--- http://wwwproxy.sandia.gov:80
Traceback (most recent call last):
  File "run.py", line 76, in <module>
    '%s/%s' % (script_remote,src), os.path.join(script_dir,src) )
  File "/projects/sierra/linux_rh6/install/Python/2.7.4/lib/python2.7/urllib.py", line 240, in retrieve
    fp = self.open(url, data)
  File "/projects/sierra/linux_rh6/install/Python/2.7.4/lib/python2.7/urllib.py", line 208, in open
    return getattr(self, name)(url)
  File "/projects/sierra/linux_rh6/install/Python/2.7.4/lib/python2.7/urllib.py", line 437, in open_https
    h.endheaders(data)
  File "/projects/sierra/linux_rh6/install/Python/2.7.4/lib/python2.7/httplib.py", line 969, in endheaders
    self._send_output(message_body)
  File "/projects/sierra/linux_rh6/install/Python/2.7.4/lib/python2.7/httplib.py", line 829, in _send_output
    self.send(msg)
  File "/projects/sierra/linux_rh6/install/Python/2.7.4/lib/python2.7/httplib.py", line 791, in send
    self.connect()
  File "/projects/sierra/linux_rh6/install/Python/2.7.4/lib/python2.7/httplib.py", line 1172, in connect
    self.timeout, self.source_address)
  File "/projects/sierra/linux_rh6/install/Python/2.7.4/lib/python2.7/socket.py", line 571, in create_connection
    raise err
IOError: [Errno socket error] [Errno 110] Connection timed out