Re: [boost] [builds] broken

Subject: Re: [boost] [builds] broken
From: Tom Kent (lists_at_[hidden])
Date: 2017-03-05 20:20:56

On Sun, Mar 5, 2017 at 11:43 AM, Rene Rivera <grafikrobot_at_[hidden]> wrote:

>
> On Sun, Mar 5, 2017 at 11:34 AM, Tom Kent <lists_at_[hidden]> wrote:
>
>>
>> On Sun, Mar 5, 2017 at 9:03 AM, Rene Rivera <grafikrobot_at_[hidden]>
>> wrote:
>>
>>> On Sun, Mar 5, 2017 at 6:49 AM, Tom Kent via Boost <
>>> boost_at_[hidden]> wrote:
>>>
>>>> On Thu, Mar 2, 2017 at 9:59 PM, Rene Rivera via Boost <
>>>> boost_at_[hidden]
>>>> > wrote:
>>>>
>>>> > On Thu, Mar 2, 2017 at 9:52 AM, Raffi Enficiaud via Boost <
>>>> > boost_at_[hidden]> wrote:
>>>> >
>>>> > > Le 02/03/2017 à 16:25, Rene Rivera via Boost a écrit :
>>>> > >
>>>> > >> On Thu, Mar 2, 2017 at 9:22 AM, Raffi Enficiaud via Boost <
>>>> > >> boost_at_[hidden]> wrote:
>>>> > >>
>>>> > >> Le 02/03/2017 à 16:20, Rene Rivera via Boost a écrit :
>>>> > >>>
>>>> > >>> On Wed, Mar 1, 2017 at 5:23 PM, Raffi Enficiaud via Boost <
>>>> > >>>> boost_at_[hidden]> wrote:
>>>> > >>>>
>>>> > >>>> Hi all,
>>>> > >>>>
>>>> > >>>>>
>>>> > >>>>> On develop, I have the following error for gcc/linux and
>>>> clang/osx:
>>>> > >>>>>
>>>> > >>>>> 01-Mar-2017 23:58:05    libs/python/build/Jamfile:155: in
>>>> > >>>>> lib_boost_numpy
>>>> > >>>>> 01-Mar-2017 23:58:05    *** argument error
>>>> > >>>>> 01-Mar-2017 23:58:05    * rule lib ( names + : sources * :
>>>> > >>>>> requirements *
>>>> > >>>>> : default-build * : usage-requirements * )
>>>> > >>>>> 01-Mar-2017 23:58:05    * called with: (  : numpy/dtype.cpp
>>>> > >>>>> numpy/matrix.cpp
>>>> > >>>>>
>>>> > >>>>>
>>>> > >>>>
>>>> > >>>> How are you configuring python in your user-config.jam?
>>>> > >>>>
>>>> > >>>>
>>>> > >>> I am not touching anything about user-config.jam: the failure
>>>> happens
>>>> > on
>>>> > >>> a
>>>> > >>> build machine (specific build user, supposedly clean). If there
>>>> is a
>>>> > >>> user-config.jam, then I do not know how it landed there :)
>>>> > >>>
>>>> > >>
>>>> > >>
>>>> > >> OK.. Which means that the version number for whatever python it
>>>> picks up
>>>> > >> is
>>>> > >> undetermined and blank. I'll have to figure out why that is.
>>>> > >>
>>>> > >
>>>> > > FYI: the Linux/OSX machines have the apt/OS python installed, and
>>>> > > python3.4.
>>>> >
>>>> >
>>>> > OK.. It turns out to have been a simple forgetting of some parens.
>>>> Note
>>>> > that bootstrap generates a project-config.jam file. So you do have
>>>> one. You
>>>> > just don't see what it is :-) But it does print out in the CI logs
>>>> what it
>>>> > detects as far as Python is concerned. Anyway.. It's fixed. And will
>>>> be
>>>> > reflected whenever stuff updates to latest develop.
>>>>
>>>>
>>>> I think this is related, but not sure...all the regression runs I start
>>>> (Linux + Windows) are currently failing with:
>>>>
>>>>  boost-test(COMPILE) "python/select_holder" :
>>>> "libs/python/test/select_holder.cpp"
>>>> boost-test(RUN) "python/select_from_python_test" :
>>>> "libs/python/test/select_from_python_test.cpp" "libs/python/src/conve
>>>> rter/type_id.cpp"
>>>> boost-test(COMPILE) "python/select_arg_to_python_test" :
>>>> "libs/python/test/select_arg_to_python_test.cpp"
>>>> boost-test(COMPILE_FAIL) "python/raw_pyobject_fail1" :
>>>> "libs/python/test/raw_pyobject_fail1.cpp"
>>>> boost-test(COMPILE_FAIL) "python/raw_pyobject_fail2" :
>>>> "libs/python/test/raw_pyobject_fail2.cpp"
>>>> boost-test(COMPILE_FAIL) "python/as_to_python_function" :
>>>> "libs/python/test/as_to_python_function.cpp"
>>>> boost-test(COMPILE_FAIL) "python/object_fail1" :
>>>> "libs/python/test/object_fail1.cpp"
>>>> error: at /var/boost/run/boost_bb/src/kernel/modules.jam:107
>>>> error: Unable to find file or target named
>>>> error:     '/boost/python//boost_numpy'
>>>> error: referred to from project at
>>>> error:     '../libs/python/test'
>>>>
>>>>  at the end of the results/bjam.log file.  This was causing develop to
>>>> fail
>>>> for awhile, and now appears to have migrated to master as well.
>>>>
>>>
>>> OK, I'm almost certain I fixed both develop and master for this now.
>>> Thanks for reporting it.
>>>
>>
>> Hmm, doesn't seem to have fixed it, still seeing the same error.
>>
>
> Hm.. Is python configured on the runners?
>

Yeah, the specific runner I'm looking at at the moment has python, both 2
(2.7.6) and 3 (3.4.3, despite what the summary page says under the python
versions):
http://www.boost.org/development/tests/develop/developer/summary.html

If you want to try that config yourself, you can get it from docker hub:
teeks99/boost-build:gcc-6

I verified that it was getting the latest commit from develop:
6abf48add87c66a7b118d0bc5e24ae045ba6fbb0

Also, I noticed that there are two errors. The end of the output looks like:

warning: toolset gcc initialization: can not find tool windres
warning: initialized from /home/boost/user-config.jam:11
notice: using rc compiler :: <toolset>gcc-6~c++1z~warn :: /usr/bin/as
notice: [python-cfg] Configuring python...
notice: [python-cfg]   user-specified version: "2.7"
notice: [python-cfg]   user-specified includes: "/usr/include/python2.7"
notice: [python-cfg]   user-specified libraries:
"/usr/lib/x86_64-linux-gnu"
notice: [python-cfg] Checking interpreter command "python2.7"...
notice: [python-cfg] running command 'python2.7 -c "from sys import *;
print('version=%d.%d\nplatform=%s\nprefix=%s\nexe
c_prefix=%s\nexecutable=%s' %
(version_info[0],version_info[1],platform,prefix,exec_prefix,executable))"
2>&1'
notice: [python-cfg] ...requested configuration matched!
notice: [python-cfg] Details of this Python configuration:
notice: [python-cfg]   interpreter command: "python2.7"
notice: [python-cfg]   include path: "/usr/include/python2.7"
notice: [python-cfg]   library path: "/usr/lib/x86_64-linux-gnu"
notice: [python-cfg] Checking for NumPy...
notice: [python-cfg] running command 'python2.7 -c "import sys; sys.stderr
= sys.stdout; import numpy; print(numpy.get_i
nclude())"'
notice: [python-cfg] NumPy disabled. Reason:
notice: [python-cfg]   python2.7 -c "import sys; sys.stderr = sys.stdout;
import numpy; print(numpy.get_include())" abor
ted with
notice: [python-cfg]   Traceback (most recent call last):
 File "<string>", line 1, in <module>
ImportError: No module named numpy
notice: [python-cfg] Configuring python...
notice: [python-cfg]   user-specified version: "3.4"
notice: [python-cfg]   user-specified includes: "/usr/include/python3.4"
notice: [python-cfg]   user-specified libraries:
"/usr/lib/x86_64-linux-gnu"
notice: [python-cfg] Checking interpreter command "python3.4"...
notice: [python-cfg] running command 'python3.4 -c "from sys import *;
print('version=%d.%d\nplatform=%s\nprefix=%s\nexe
c_prefix=%s\nexecutable=%s' %
(version_info[0],version_info[1],platform,prefix,exec_prefix,executable))"
2>&1'
notice: [python-cfg] ...requested configuration matched!
notice: [python-cfg] Details of this Python configuration:
notice: [python-cfg]   interpreter command: "python3.4"
notice: [python-cfg]   include path: "/usr/include/python3.4"
notice: [python-cfg]   library path: "/usr/lib/x86_64-linux-gnu"
notice: [python-cfg] Checking for NumPy...
notice: [python-cfg] running command 'python3.4 -c "import sys; sys.stderr
= sys.stdout; import numpy; print(numpy.get_i
nclude())"'
notice: [python-cfg] ...requested configuration matched!
notice: [python-cfg] Details of this Python configuration:
notice: [python-cfg]   interpreter command: "python3.4"
notice: [python-cfg]   include path: "/usr/include/python3.4"
notice: [python-cfg]   library path: "/usr/lib/x86_64-linux-gnu"
notice: [python-cfg] Checking for NumPy...
notice: [python-cfg] running command 'python3.4 -c "import sys; sys.stderr
= sys.stdout; import numpy; print(numpy.get_i
nclude())"'
notice: [python-cfg] NumPy disabled. Reason:
notice: [python-cfg]   python3.4 -c "import sys; sys.stderr = sys.stdout;
import numpy; print(numpy.get_include())" abor
ted with
notice: [python-cfg]   Traceback (most recent call last):
 File "<string>", line 1, in <module>
ImportError: No module named 'numpy'
notice: [zlib] Using pre-installed library
notice: [zlib] Condition
notice: [bzip2] Using pre-installed library
notice: [bzip2] Condition
Performing configuration checks

   - 32-bit                   : no
   - 64-bit                   : yes
   - arm                      : no
   - mips1                    : no
   - power                    : no
   - sparc                    : no
   - x86                      : yes
   - symlinks supported       : yes
...found 1067 targets...
# Starting tests ("/var/boost/run/boost_bb/src/engine/bin.linuxx86_64/b2"
"-sBOOST_BUILD_PATH=/var/boost/run:/var/boost/
run/boost_bb/src" "-sBOOST_ROOT=/var/boost/run/boost_root"
"--boost=/var/boost/run/boost_root" "--boost-root=/var/boost/
run/boost_root" "--boost-build=/var/boost/run/boost_bb/src"
"--debug-configuration"  -l300 toolset=gcc-6~c++1z -d2 prese
rve-test-targets=off --dump-tests -j8 address-model=64
--remove-test-targets -m64 "--build-dir=/var/boost/run/results" >
>"/var/boost/run/results/bjam.log" 2>&1)...
# Running Boost.Build tests
Traceback (most recent call last):
 File "run.py", line 71, in <module>
   runner(root)
 File "/var/boost/run/boost_regression_src/regression.py", line 287, in
__init__
   self.main()
 File "/var/boost/run/boost_regression_src/regression.py", line 624, in
main
   getattr(self,action_m)()
 File "/var/boost/run/boost_regression_src/regression.py", line 589, in
command_regression
   self.command_test()
 File "/var/boost/run/boost_regression_src/regression.py", line 368, in
command_test
   self.command_test_boost_build()
 File "/var/boost/run/boost_regression_src/regression.py", line 410, in
command_test_boost_build
   "boost/bin.v2/libs/any/test/any_test.test"));
OSError: [Errno 2] No such file or directory:
'/var/boost/run/results/boost/bin.v2/libs/any/test/any_test.test'

While the end of the results/bjam.log is:
boost-test(RUN) "ptr_container/const_element_containers" :
"libs/ptr_container/test/const_element_containers.cpp"
boost-test(RUN_PYD) "ptr_container/__boost_check_library__" :
"status/boost_check_library.py"
boost-test(RUN) "python/exec" : "libs/python/test/exec.cpp"
boost-test(RUN) "python/exec-dynamic" : "libs/python/test/exec.cpp"
boost-test(RUN_PYD) "python/crossmod_exception" :
"libs/python/test/crossmod_exception.py" "libs/python/test/crossmod_ex
ception_a.cpp" "libs/python/test/crossmod_exception_b.cpp"
boost-test(RUN_PYD) "python/injected" : "libs/python/test/injected.py"
"libs/python/test/injected.cpp"
boost-test(RUN_PYD) "python/properties" : "libs/python/test/properties.py"
"libs/python/test/properties.cpp"
boost-test(RUN_PYD) "python/return_arg" : "libs/python/test/return_arg.py"
"libs/python/test/return_arg.cpp"
boost-test(RUN_PYD) "python/staticmethod" :
"libs/python/test/staticmethod.py" "libs/python/test/staticmethod.cpp"
boost-test(RUN_PYD) "python/boost_shared_ptr" :
"libs/python/test/boost_shared_ptr.py" "libs/python/test/boost_shared_pt
r.cpp"
boost-test(RUN_PYD) "python/shared_ptr" : "libs/python/test/shared_ptr.py"
"libs/python/test/shared_ptr.cpp"
boost-test(RUN_PYD) "python/enable_shared_from_this" :
"libs/python/test/enable_shared_from_this.py" "libs/python/test/e
nable_shared_from_this.cpp"
boost-test(RUN_PYD) "python/andreas_beyer" :
"libs/python/test/andreas_beyer.py" "libs/python/test/andreas_beyer.cpp"
boost-test(RUN_PYD) "python/wrapper_held_type" :
"libs/python/test/wrapper_held_type.py" "libs/python/test/wrapper_held_
type.cpp"
boost-test(RUN_PYD) "python/polymorphism2_auto_ptr" :
"libs/python/test/polymorphism2_auto_ptr.py" "libs/python/test/pol
ymorphism2.py" "libs/python/test/polymorphism2_auto_ptr.cpp"
boost-test(RUN_PYD) "python/polymorphism" :
"libs/python/test/polymorphism.py" "libs/python/test/polymorphism.cpp"
boost-test(RUN_PYD) "python/polymorphism2" :
"libs/python/test/polymorphism2.py" "libs/python/test/polymorphism2.cpp"
boost-test(RUN_PYD) "python/auto_ptr" : "libs/python/test/auto_ptr.py"
"libs/python/test/auto_ptr.cpp"
boost-test(RUN_PYD) "python/minimal" : "libs/python/test/minimal.py"
"libs/python/test/minimal.cpp"
boost-test(RUN_PYD) "python/args" : "libs/python/test/args.py"
"libs/python/test/args.cpp"
boost-test(RUN_PYD) "python/raw_ctor" : "libs/python/test/raw_ctor.py"
"libs/python/test/raw_ctor.cpp"
boost-test(RUN_PYD) "python/enum" : "libs/python/test/test_enum.py"
"libs/python/test/enum_ext.cpp"
boost-test(RUN_PYD) "python/exception_translator" :
"libs/python/test/exception_translator.py" "libs/python/test/excepti
on_translator.cpp"
boost-test(RUN_PYD) "python/pearu1" : "libs/python/test/test_cltree.py"
"libs/python/test/cltree.cpp"
boost-test(RUN_PYD) "python/try" : "libs/python/test/newtest.py"
"libs/python/test/m1.cpp" "libs/python/test/m2.cpp"
boost-test(RUN_PYD) "python/const_argument" :
"libs/python/test/const_argument.py" "libs/python/test/const_argument.cpp"
boost-test(RUN_PYD) "python/keywords" : "libs/python/test/keywords.cpp"
"libs/python/test/keywords_test.py"
boost-test(RUN_PYD) "python/builtin_converters" :
"libs/python/test/test_builtin_converters.py"
boost-test(RUN_PYD) "python/test_pointer_adoption" :
"libs/python/test/test_pointer_adoption.py" "libs/python/test/test_
pointer_adoption.cpp"
boost-test(RUN_PYD) "python/operators" : "libs/python/test/operators.py"
"libs/python/test/operators.cpp"
boost-test(RUN_PYD) "python/operators_wrapper" :
"libs/python/test/operators_wrapper.py" "libs/python/test/operators_wra
pper.cpp"
boost-test(RUN_PYD) "python/callbacks" : "libs/python/test/callbacks.py"
"libs/python/test/callbacks.cpp"
boost-test(RUN_PYD) "python/defaults" : "libs/python/test/defaults.py"
"libs/python/test/defaults.cpp"
boost-test(RUN_PYD) "python/object" : "libs/python/test/object.py"
"libs/python/test/object.cpp"
boost-test(RUN_PYD) "python/class" : "libs/python/test/class.py"
"libs/python/test/class.cpp"
boost-test(RUN_PYD) "python/list" : "libs/python/test/list.py"
"libs/python/test/list.cpp"
boost-test(RUN_PYD) "python/long" : "libs/python/test/long.py"
"libs/python/test/long.cpp"
boost-test(RUN_PYD) "python/dict" : "libs/python/test/dict.py"
"libs/python/test/dict.cpp"
boost-test(RUN_PYD) "python/tuple" : "libs/python/test/tuple.py"
"libs/python/test/tuple.cpp"
boost-test(RUN_PYD) "python/str" : "libs/python/test/str.py"
"libs/python/test/str.cpp"
boost-test(RUN_PYD) "python/slice" : "libs/python/test/slice.py"
"libs/python/test/slice.cpp"
boost-test(RUN_PYD) "python/virtual_functions" :
"libs/python/test/virtual_functions.py" "libs/python/test/virtual_funct
ions.cpp"
boost-test(RUN_PYD) "python/back_reference" :
"libs/python/test/back_reference.py" "libs/python/test/back_reference.cpp"
boost-test(RUN_PYD) "python/implicit" : "libs/python/test/implicit.py"
"libs/python/test/implicit.cpp"
boost-test(RUN_PYD) "python/data_members" :
"libs/python/test/data_members.py" "libs/python/test/data_members.cpp"
boost-test(RUN_PYD) "python/ben_scott1" : "libs/python/test/ben_scott1.py"
"libs/python/test/ben_scott1.cpp"
boost-test(RUN_PYD) "python/bienstman1" : "libs/python/test/bienstman1.py"
"libs/python/test/bienstman1.cpp"
boost-test(RUN_PYD) "python/bienstman2" : "libs/python/test/bienstman2.py"
"libs/python/test/bienstman2.cpp"
boost-test(RUN_PYD) "python/bienstman3" : "libs/python/test/bienstman3.py"
"libs/python/test/bienstman3.cpp"
boost-test(RUN_PYD) "python/multi_arg_constructor" :
"libs/python/test/multi_arg_constructor.py" "libs/python/test/multi
_arg_constructor.cpp"
oost-test(RUN_PYD) "python/iterator" : "libs/python/test/iterator.py"
"libs/python/test/iterator.cpp" "libs/python/test
/input_iterator.cpp"
boost-test(RUN_PYD) "python/stl_iterator" :
"libs/python/test/stl_iterator.py" "libs/python/test/stl_iterator.cpp"
boost-test(RUN_PYD) "python/extract" : "libs/python/test/extract.py"
"libs/python/test/extract.cpp"
boost-test(RUN_PYD) "python/crossmod_opaque" :
"libs/python/test/crossmod_opaque.py" "libs/python/test/crossmod_opaque_a
.cpp" "libs/python/test/crossmod_opaque_b.cpp"
boost-test(RUN_PYD) "python/opaque" : "libs/python/test/opaque.py"
"libs/python/test/opaque.cpp"
boost-test(RUN_PYD) "python/voidptr" : "libs/python/test/voidptr.py"
"libs/python/test/voidptr.cpp"
boost-test(RUN_PYD) "python/pickle1" : "libs/python/test/pickle1.py"
"libs/python/test/pickle1.cpp"
boost-test(RUN_PYD) "python/pickle2" : "libs/python/test/pickle2.py"
"libs/python/test/pickle2.cpp"
boost-test(RUN_PYD) "python/pickle3" : "libs/python/test/pickle3.py"
"libs/python/test/pickle3.cpp"
boost-test(RUN_PYD) "python/pickle4" : "libs/python/test/pickle4.py"
"libs/python/test/pickle4.cpp"
boost-test(RUN_PYD) "python/nested" : "libs/python/test/nested.py"
"libs/python/test/nested.cpp"
boost-test(RUN_PYD) "python/docstring" : "libs/python/test/docstring.py"
"libs/python/test/docstring.cpp"
boost-test(RUN_PYD) "python/pytype_function" :
"libs/python/test/pytype_function.py" "libs/python/test/pytype_function.c
pp"
boost-test(RUN_PYD) "python/vector_indexing_suite" :
"libs/python/test/vector_indexing_suite.py" "libs/python/test/vecto
r_indexing_suite.cpp"
boost-test(RUN_PYD) "python/pointer_vector" :
"libs/python/test/pointer_vector.py" "libs/python/test/pointer_vector.cpp"
boost-test(RUN_PYD) "python/map_indexing_suite" :
"libs/python/test/map_indexing_suite.py"
boost-test(RUN) "python/import_" : "libs/python/test/import_.cpp"
boost-test(RUN_PYD) "python/calling_conventions" :
"libs/python/test/calling_conventions.py" "libs/python/test/calling_c
onventions.cpp"
boost-test(RUN_PYD) "python/calling_conventions_mf" :
"libs/python/test/calling_conventions_mf.py" "libs/python/test/cal
ling_conventions_mf.cpp"
boost-test(COMPILE) "python/indirect_traits_test" :
"libs/python/test/indirect_traits_test.cpp"
boost-test(RUN) "python/destroy_test" : "libs/python/test/destroy_test.cpp"
boost-test(RUN) "python/pointer_type_id_test" :
"libs/python/test/pointer_type_id_test.cpp"
boost-test(RUN) "python/bases" : "libs/python/test/bases.cpp"
boost-test(RUN) "python/if_else" : "libs/python/test/if_else.cpp"
boost-test(RUN) "python/pointee" : "libs/python/test/pointee.cpp"
boost-test(RUN) "python/result" : "libs/python/test/result.cpp"
boost-test(COMPILE) "python/string_literal" :
"libs/python/test/string_literal.cpp"
boost-test(COMPILE) "python/borrowed" : "libs/python/test/borrowed.cpp"
boost-test(COMPILE) "python/object_manager" :
"libs/python/test/object_manager.cpp"
boost-test(COMPILE) "python/copy_ctor_mutates_rhs" :
"libs/python/test/copy_ctor_mutates_rhs.cpp"
boost-test(RUN) "python/upcast" : "libs/python/test/upcast.cpp"
boost-test(COMPILE) "python/select_holder" :
"libs/python/test/select_holder.cpp"
boost-test(RUN) "python/select_from_python_test" :
"libs/python/test/select_from_python_test.cpp" "libs/python/src/conve
rter/type_id.cpp"
boost-test(COMPILE) "python/select_arg_to_python_test" :
"libs/python/test/select_arg_to_python_test.cpp"
boost-test(COMPILE_FAIL) "python/raw_pyobject_fail1" :
"libs/python/test/raw_pyobject_fail1.cpp"
boost-test(COMPILE_FAIL) "python/raw_pyobject_fail2" :
"libs/python/test/raw_pyobject_fail2.cpp"
boost-test(COMPILE_FAIL) "python/as_to_python_function" :
"libs/python/test/as_to_python_function.cpp"
boost-test(COMPILE_FAIL) "python/object_fail1" :
"libs/python/test/object_fail1.cpp"
error: at /var/boost/run/boost_bb/src/kernel/modules.jam:107
error: Unable to find file or target named
error:     '/boost/python//boost_numpy'
error: referred to from project at
error:     '../libs/python/test'

Hope that helps,
Tom