Re: [boost] [Hana] Integration with the regression Matrix

Subject: Re: [boost] [Hana] Integration with the regression Matrix
From: Rene Rivera (grafikrobot_at_[hidden])
Date: 2015-10-09 21:37:27

[Puts Testing Manager hat on..]

On Fri, Oct 9, 2015 at 5:05 PM, Louis Dionne <ldionne.2_at_[hidden]> wrote:

> Hi,
>
> With the goal of shipping Hana with the next release of Boost, I am
> currently
> trying to satisfy the requirement that Hana's testing results show up in
> the
> Boost regression matrix. One way to achieve this would be to have Travis CI
> upload the results on each push to master.
>
> To do so, I would need to somehow create an XML file compatible with what
> the regression matrix expects. That brings up a few questions:
>
> (1) Is there a way to upload the result of CMake tests to the Boost
> regression
>     matrix? I suspect something like that might have already been done as
> part
>     of the (unfortunately defunct) CMake effort?
>

There is no way, currently.

(2) If not, would it be difficult to implement?
>

It would be difficult. As it would require dealing with it at almost every
level of the testing process.

Any input on how to best integrate Hana's testing results with the rest of
> Boost's regression testing will be greatly appreciated.
>

As others have mentioned. You need to support Boost Build for integration
into the rest of Boost. And that's not just testing. But it could also mean
documentation and release/distribution.

Also, before someone suggests using Boost.Build: I have been looking at the
> possibility of maintaining a separate Jamfile. However, the need to
> maintain
> two separate build systems is annoying, so I'd like to avoid it if
> possible.
>

Can't be avoided.. But, if it's any consolation, I'm fairly certain that
the Jamfile is going to be considerably smaller than the cmakelists.txt you
have now.

> I also think that Travis-based testing could provide a better coverage for
> Hana than the voluntary testers given the need for cutting edge compilers,
> but I could be wrong.
>

As a user of Travis myself, I can say you are wrong. Travis support for C++
testing is minimal. And you have to go through extra lengths to get any
cutting edge compilers. And Travis will never have what Boost testing some
times has.. Pre-release proprietary compilers from vendors on non-Unix
platforms.

-- 
-- Rene Rivera
-- Grafik - Don't Assume Anything
-- Robot Dreams - http://robot-dreams.net
-- rrivera/acm.org (msn) - grafikrobot/aim,yahoo,skype,efnet,gmail