Re: [Boost-testing] False failures?

From: Misha Bergal (mbergal_at_[hidden])
Date: 2007-02-06 21:45:20

David Abrahams wrote:
> David Abrahams <dave_at_[hidden]> writes:
> 
>> I can send the one I have lying around at the moment.  I don't know
>> whether that's the "first run".  Done as
>> BoostConsulting-20070206-bjam.log
> 
> (on the ftp server, of course).
> 
That was the right one. There is something funny going on, the 
regression system seems to be quite correct about this one:

First run:

--- bjam.log ---
compile-c-c++ 
Z:\results\boost\bin.v2\libs\algorithm\string\test\replace.test\msvc-8.0.m\rls\adrs-mdl-64\instr-set-optrn\thrd-mlt\replace_test.obj

     call "C:\Program Files (x86)\Microsoft Visual Studio 
8\VC\vcvarsall.bat" amd64 >nul
cl /Zm800 -nologo 
@"Z:\results\boost\bin.v2\libs\algorithm\string\test\replace.test\msvc-8.0.m\rls\adrs-mdl-64\instr-set-optrn\thrd-mlt\replace_test.obj.rsp" 

replace_test.cpp
...failed compile-c-c++ 
Z:\results\boost\bin.v2\libs\algorithm\string\test\replace.test\msvc-8.0.m\rls\adrs-mdl-64\instr-set-optrn\thrd-mlt\replace_test.obj...
...skipped 
<pZ:\results\boost\bin.v2\libs\algorithm\string\test\replace.test\msvc-8.0.m\rls\adrs-mdl-64\instr-set-optrn\thrd-mlt>replace.exe 
for lack of 
<pZ:\results\boost\bin.v2\libs\algorithm\string\test\replace.test\msvc-8.0.m\rls\adrs-mdl-64\instr-set-optrn\thrd-mlt>replace_test.obj...
...skipped 
<pZ:\results\boost\bin.v2\libs\algorithm\string\test\replace.test\msvc-8.0.m\rls\adrs-mdl-64\instr-set-optrn\thrd-mlt>replace.run 
for lack of 
<pZ:\results\boost\bin.v2\libs\algorithm\string\test\replace.test\msvc-8.0.m\rls\adrs-mdl-64\instr-set-optrn\thrd-mlt>replace.exe...
--- /bjam.log ---

Looks like the compiler returned error code but still produced an .obj 
file that got picked up on the second (incremental) run and successfully 
linked and run:

--- bjam.log ---
"Z:\results\boost\bin.v2\libs\algorithm\string\test\replace.test\msvc-8.0.m\rls\adrs-mdl-64\instr-set-optrn\thrd-mlt\replace_test.obj"

msvc.link 
Z:\results\boost\bin.v2\libs\algorithm\string\test\replace.test\msvc-8.0.m\rls\adrs-mdl-64\instr-set-optrn\thrd-mlt\replace.exe

         call "C:\Program Files (x86)\Microsoft Visual Studio 
8\VC\vcvarsall.bat" amd64 >nul
link /NOLOGO /INCREMENTAL:NO /subsystem:console 
/out:"Z:\results\boost\bin.v2\libs\algorithm\string\test\replace.test\msvc-8.0.m\rls\adrs-mdl-64\instr-set-optrn\thrd-mlt\replace.exe" 
 
@"Z:\results\boost\bin.v2\libs\algorithm\string\test\replace.test\msvc-8.0.m\rls\adrs-mdl-64\instr-set-optrn\thrd-mlt\replace.exe.rsp"
         if %ERRORLEVEL% NEQ 0 EXIT %ERRORLEVEL%
         if exist 
"Z:\results\boost\bin.v2\libs\algorithm\string\test\replace.test\msvc-8.0.m\rls\adrs-mdl-64\instr-set-optrn\thrd-mlt\replace.exe.manifest" 
(
             mt -nologo -manifest 
"Z:\results\boost\bin.v2\libs\algorithm\string\test\replace.test\msvc-8.0.m\rls\adrs-mdl-64\instr-set-optrn\thrd-mlt\replace.exe.manifest" 
"-outputresource:Z:\results\boost\bin.v2\libs\algorithm\string\test\replace.test\msvc-8.0.m\rls\adrs-mdl-64\instr-set-optrn\thrd-mlt\replace.exe;1"
         )

testing.capture-output 
Z:\results\boost\bin.v2\libs\algorithm\string\test\replace.test\msvc-8.0.m\rls\adrs-mdl-64\instr-set-optrn\thrd-mlt\replace.run

 
"Z:\results\boost\bin.v2\libs\algorithm\string\test\replace.test\msvc-8.0.m\rls\adrs-mdl-64\instr-set-optrn\thrd-mlt\replace.exe" 
   > 
"Z:\results\boost\bin.v2\libs\algorithm\string\test\replace.test\msvc-8.0.m\rls\adrs-mdl-64\instr-set-optrn\thrd-mlt\replace.output" 
2>&1
     set status=%ERRORLEVEL%
     echo. >> 
"Z:\results\boost\bin.v2\libs\algorithm\string\test\replace.test\msvc-8.0.m\rls\adrs-mdl-64\instr-set-optrn\thrd-mlt\replace.output"
     echo EXIT STATUS: %status% >> 
"Z:\results\boost\bin.v2\libs\algorithm\string\test\replace.test\msvc-8.0.m\rls\adrs-mdl-64\instr-set-optrn\thrd-mlt\replace.output"
     if %status% EQU 0 (
         copy 
"Z:\results\boost\bin.v2\libs\algorithm\string\test\replace.test\msvc-8.0.m\rls\adrs-mdl-64\instr-set-optrn\thrd-mlt\replace.output" 
"Z:\results\boost\bin.v2\libs\algorithm\string\test\replace.test\msvc-8.0.m\rls\adrs-mdl-64\instr-set-optrn\thrd-mlt\replace.run"
     )
     set verbose=0
     if %status% NEQ 0 (
         set verbose=1
     )
     if %verbose% EQU 1 (
         echo ====== BEGIN OUTPUT ======
         type 
"Z:\results\boost\bin.v2\libs\algorithm\string\test\replace.test\msvc-8.0.m\rls\adrs-mdl-64\instr-set-optrn\thrd-mlt\replace.output"
         echo ====== END OUTPUT ======
     )
     exit %status%

         1 file(s) copied.
RmTemps 
Z:\results\boost\bin.v2\libs\algorithm\string\test\replace.test\msvc-8.0.m\rls\adrs-mdl-64\instr-set-optrn\thrd-mlt\replace.run

     del /f /q 
"Z:\results\boost\bin.v2\libs\algorithm\string\test\replace.test\msvc-8.0.m\rls\adrs-mdl-64\instr-set-optrn\thrd-mlt\replace.exe"

**passed** 
Z:\results\boost\bin.v2\libs\algorithm\string\test\replace.test\msvc-8.0.m\rls\adrs-mdl-64\instr-set-optrn\thrd-mlt\replace.test
--- /bjam.log ---

Weird. IMHO, we need to:

1. See if this is compiler returning an error or it is BoostBuild 
incorrectly reporting a failure "...failed compile-c-c++ ".

2. If it is compiler returning an error, we might try to look it up in 
the docs.

3. We need to see if it happens in more localized case, running this 
test only etc.

I guess I cannot do much about it here - issue seems to be pretty 
specific to particular compiler. Can you try to tweak BoostBuild to 
clearly see what is going on on your end?

--
Misha Bergal
MetaCommunications Engineering