- Boost-users - lists.boost.org

[Foreach] tweaked for speed -- a kludge worth refining?
by Paul Tuinenga 10 Jul '12

10 Jul '12

I admire the tight machine code BOOST_FOREACH teases compilers into generating. So what could be my problem? More speed! I have a situation with gathering floating-point data that may be of such low interest it's not worth pursuing for the library. In any case, I have my work-around (described below) that gets the job done. In this case, the need to accumulate: 1) using vectors of indices into another data vector (very NUMA) i.e. data[index] 2) there is always at least one index 3) majority of cases are two indices 4) but there may be several indices Obviously, it is best to go ahead and immediately process the (guaranteed) first index. This hides the cost of increment and loop-test in the latency of data fetch, even from L1 cache. But BOOST_FOREACH does not do that. So I hacked the macro. Works great! Creates the tightest machine code, boosting 2-element cases to the hardware limit (SSE/AVX instructions). Yes, there is the curly braces thing -- "crude but effective" is all I'm claiming. I'm sure there are better ways to alter the macro and/or use model; I'm interested to hear about that. - paul Example use: double accum = 0; ORG_BOOST_FOREACH(unsigned i, index) accum += data[i]; double temp, accum = 0; MOD_BOOST_FOREACH(unsigned i, index, temp = data[i]) accum += temp; temp = data[i]; } accum += temp; /////////////////////////////////////////////////////////////////////////////////////////////////////////////////// #define ORG_BOOST_FOREACH(VAR, COL) \ BOOST_FOREACH_PREAMBLE() \ if (boost::foreach_detail_::auto_any_t BOOST_FOREACH_ID(_foreach_col) = BOOST_FOREACH_CONTAIN(COL)) \ {} \ else if (boost::foreach_detail_::auto_any_t BOOST_FOREACH_ID(_foreach_cur) = BOOST_FOREACH_BEGIN(COL)) \ {} \ else if (boost::foreach_detail_::auto_any_t BOOST_FOREACH_ID(_foreach_end) = BOOST_FOREACH_END(COL)) \ {} \ else \ for (bool BOOST_FOREACH_ID(_foreach_continue) = true; \ BOOST_FOREACH_ID(_foreach_continue) && !BOOST_FOREACH_DONE(COL); \ BOOST_FOREACH_ID(_foreach_continue) ? BOOST_FOREACH_NEXT(COL) : (void)0) \ if (boost::foreach_detail_::set_false(BOOST_FOREACH_ID(_foreach_continue))) \ {} \ else \ for (VAR = BOOST_FOREACH_DEREF(COL); !BOOST_FOREACH_ID(_foreach_continue); BOOST_FOREACH_ID(_foreach_continue) = true) #define MOD_BOOST_FOREACH(VAR, COL, TMP) \ BOOST_FOREACH_PREAMBLE() \ if (boost::foreach_detail_::auto_any_t BOOST_FOREACH_ID(_foreach_col) = BOOST_FOREACH_CONTAIN(COL)) \ {} \ else if (boost::foreach_detail_::auto_any_t BOOST_FOREACH_ID(_foreach_cur) = BOOST_FOREACH_BEGIN(COL)) \ {} \ else if (boost::foreach_detail_::auto_any_t BOOST_FOREACH_ID(_foreach_end) = BOOST_FOREACH_END(COL)) \ {} \ else if (bool BOOST_FOREACH_ID(_foreach_continue) = false) \ {} \ else \ { \ /* some kind of BOOST-MPL "assert" here (debug only) to insure there is one item at least */ \ for (VAR = BOOST_FOREACH_DEREF(COL); !BOOST_FOREACH_ID(_foreach_continue); BOOST_FOREACH_ID(_foreach_continue) = true) \ TMP; \ for (BOOST_FOREACH_ID(_foreach_continue) ? BOOST_FOREACH_NEXT(COL) : (void)0; \ BOOST_FOREACH_ID(_foreach_continue) && !BOOST_FOREACH_DONE(COL); \ BOOST_FOREACH_ID(_foreach_continue) ? BOOST_FOREACH_NEXT(COL) : (void)0) \ if (boost::foreach_detail_::set_false(BOOST_FOREACH_ID(_foreach_continue))) \ {} \ else \ for (VAR = BOOST_FOREACH_DEREF(COL); !BOOST_FOREACH_ID(_foreach_continue); BOOST_FOREACH_ID(_foreach_continue) = true) ///////////////////////////////////////////////////////////////////////////////////////////////////////////////////

1 0

chaining ouput iterator to input iterator
by MM 09 Jul '12

09 Jul '12

Hi, I have a function that transforms a serie of numbers into another serie: template <typename InputIterator, typename OutputIterator> void transform( InputIterator begin, InputIterator end, OutputIterator out ) { } and a 2nd function that calculates the standard deviation of a sample template <typename InputIterator > double stdev( InputIterator begin, InputIterator end) { } Is there a way to chain these existing functions in order to get the std dev of the transformed serie, without storing the intermediate numbers? Maybe with the help of some lazy iterator, or some lazy function? MM

4 10

[Multi Index] Random Access Index C2247 Compile Error
by Steve Hibbert 09 Jul '12

09 Jul '12

Igor, thanks for getting back to me. Very good suggestion. I was trying to gain 'direct random access' to the items in the container by using the bracket operator on the MIC object, as you would do on a vector... "m_micOrders[index]". This is how example 10 in the Boost documentation shows the usage, using a text block stored in a MIC called tc, and using tc[pos] to access the pos'th element. After a review of the MIC source code and a bit of thinking, I have tried first getting a reference to the random access index, and then using the bracket operator on the reference to the index like this (where the random index is the seventh defined index in my case)... OrderMIC::nth_index<6>::type& index6 = m_micOrders.get<6>(); spOrder = index6[ index ]; It seems a general rule with MIC's is that you should never call any member functions on anything other than a reference to one of the indices. So, thanks very much for your help, and I am off and running again, much obliged. Steve

2 1

[Multi Index] Random Access Index C2247 Compile Error
by Steve Hibbert 09 Jul '12

09 Jul '12

Thanks very much to Steven Watanabe for getting back to me regarding my lower_bound/upper_bound question - I will take a look at equal_range() as suggested. I have been reading around and found the random_access index. This is useful to me to find any random item in my multi_index container. I am having a problem compiling though, I get error c2247 when I try to use the square bracket operator [] to access a randomly indexed item. The error message says that this is an inheritance issue with the protected status of the operator... c:\program files\microsoft visual studio\myprojects\xmltest\xmltest\xmltestapp.cpp(899) : error C2247: 'boost::multi_index::detail::random_access_index<SuperMeta,TagList>::operator []' not accessible because 'boost::multi_index::detail::ordered_index<KeyFromValue,Compare,SuperMeta,TagList,Category>' uses 'protected' to inherit from 'boost::multi_index::detail::random_access_index<SuperMeta,TagList>' I have based my code on example 10 in the Multi Index Documentation source examples. I can see that Daniel Bradburn had the same problem, detailed in a post dated April 6th 2010. Joaquin M Lopez Munoz responded, asking for a little test project to demonstrate, but there I can find no resolution to his (and, thus, my) question. I have also tried using the "#define BOOST_NO_MEMBER_TEMPLATE_FRIENDS" line, but no joy. For now, I can work around by either hacking the protected state to public or iterating the container to a random point. I have updated Boost to 1_50 and created an isolated test case in a small project to replicate the issue. I am using Visual Studio 9 on Windows Vista. Thanks in advance for any help with this. Steve

2 2

Re: [Boost-users] Include sqlite3 in Jam.root file
by Damian 07 Jul '12

07 Jul '12

Hi Steven, Thanks for the quick reply. I've made progress with your information but I still can't compile. The new error is with the linker: /usr/bin/ld: cannot find -lsqlite3 Here is my Jamroot file (minus the hash marks): I would have thought that /usr/include was in the default search path for g++. Any ideas? ############################################### lib sqlite3 ; exe mainApp : ## sources sqlite3 [ glob ./src/*.cpp ] : ## requirements <include>/usr/include <include>./pwiz_root/boost_1_43_0 <include>./pwiz_root/libraries/boost_aux #<include>./src/threadpool/boost <include>./pwiz_root/pwiz <include>./pwiz_root/ext/boost/regex <library>./pwiz_root/pwiz/data/msdata//pwiz_data_msdata <library>./pwiz_root/pwiz/utility/misc//pwiz_utility_misc : ## requirements <warnings>all <threading>multi <toolset>gcc <link>static #<cxxflags> <optimization>speed <variant>release : ## default-build ; #################################################### > > > ------------------------------ > > Message: 2 > Date: Fri, 06 Jul 2012 21:05:55 -0700 > From: Steven Watanabe <watanabesj(a)gmail.com> > To: boost-users(a)lists.boost.org > Subject: Re: [Boost-users] Include sqlite3 in Jam.root file > Message-ID: <4FF7B5A3.1000800(a)providere-consulting.com> > Content-Type: text/plain; charset=ISO-8859-1 > > AMDG > > On 07/06/2012 07:25 PM, Damian wrote: >> Hello. >> >> I'm trying to compile a C++ project using boost/bjam that uses SQLite3. >> >> Normally I would: g++ main.cpp -lsqlite3 -o main.exe >> >> But I don't know how to specify the library in the Jam file. >> >> Can someone tell me how you specify the libraries in a jam file? >> >> I'm using RHEL 6.2 (64bit) in case it matters. >> >> Thanks in advance for any and all help. >> > > lib sqlite3 ; > exe main : main.cpp sqlite3 ; > > In Christ, > Steven Watanabe >

2 1

Include sqlite3 in Jam.root file
by Damian 07 Jul '12

07 Jul '12

Hello. I'm trying to compile a C++ project using boost/bjam that uses SQLite3. Normally I would: g++ main.cpp -lsqlite3 -o main.exe But I don't know how to specify the library in the Jam file. Can someone tell me how you specify the libraries in a jam file? I'm using RHEL 6.2 (64bit) in case it matters. Thanks in advance for any and all help. Damian -------------------------------------------------------------------------------- "There is no gene for the Human Spirit" -- GATTACA --------------------------------------------------------------------------------

2 1

[Serialization] msvc derived class in dll throws archive_exception::unregistered_class
by drivehappy 06 Jul '12

06 Jul '12

Hi, This is (yet another) question about the archive_exception::unregistered_class ("derived class not registered or exported"). I've tried to find as much information before posting here, but frankly I'm stumped at this point. I believe this SO topic (http://stackoverflow.com/questions/9189055/put-the-serialization-of-a-class…) is pretty much the exact same problem I'm having if you want more code to look at. The problem is that the archive_exception::unregistered_class exception is thrown when attempting to serialize via a base class pointer that is instantiated as a derived type defined in a shared library (DLL). The declaration and definition for the serialization is split between a header/cpp respectively. Serializing in the same manner, but with the derived class defined in the same executable works correctly. To hopefully answer the easy questions right away: the header contains the BOOST_CLASS_EXPORT_KEY macro and the cpp contains the BOOST_CLASS_EXPORT_IMPLEMENT with the defined exported templated functions for the binary_iarchive and binary_oarchive, e.g.: header: BOOST_CLASS_EXPORT_KEY(derivedClass) cpp: BOOST_CLASS_EXPORT_IMPLEMENT(derivedClass) template LIB_LINKAGE void derivedClass::serialize(boost::archive::binary_iarchive & ar, const unsigned int version); template LIB_LINKAGE void derivedClass::serialize(boost::archive::binary_oarchive & ar, const unsigned int version); The derivedClass::serialize contains the serialization for the base class, e.g.: template <class Archive> void ModuleStarted::serialize(Archive & ar, unsigned int) { ar & boost::serialization::base_object<baseClass>(*this); } My problem only exists under msvc (have not tried other versions but using 9 with SP1), building under g++ 4.6.3 works correctly. I have tested with Boost 1.49.0 and 1.50.0. Some discussions mentioned placing the BOOST_CLASS_EXPORT_* macros after the export.hpp #include, and even having the export.hpp included after the archive headers, all of which don't appear to work. I have also created a standalone VS solution with the executable and dll projects from the Boost.Serialization test code (test_dll_export, with polymorphic_base and polymorphic_derived2) and the same problem still occurs. I have attached this file (unfortunately the include paths will need to be modified) - it's built against Boost 1.50.0. I've looked at the following discussions: http://www.boost.org/doc/libs/1_50_0/libs/serialization/doc/special.html#dl… (The manual, I've triple-checked this). http://lists.boost.org/boost-users/2011/01/65295.php (Robert modified a VS solution but the zip was never attached properly, so I cannot check this). Thanks, Mark

1 0

My personally built boost gives me remove_reference.hpp:39:29: error: template argument 1 is invalid type messages
by Jim Galarowicz 06 Jul '12

06 Jul '12

Hi all, I'm wondering if anyone has seen this issue before and might be able to point out what I'm doing wrong. I'm building boost into a local directory on systems where I don't have root privileges and need to use boost for our tool development. Here is the snippet of code I'm using to build boost (1.48 or 1.49). Both give me the problem(s) outlined below. cp SOURCES/boost_$boostver.tar.gz BUILD/$sys/boost_$boostver.tar.gz cd BUILD/$sys tar -xzvf boost_$boostver.tar.gz cd boost_$boostver ./bootstrap.sh --prefix=$OPENSS_BOOST_ROOT ./bjam --layout=tagged --prefix=$OPENSS_BOOST_ROOT --libdir=$OPENSS_BOOST_ROOT/$LIBDIR --includedir=$OPENSS_BOOST_ROOT/include threading=multi install cd ../../.. I believe I was able to build earlier versions of boost (1.45) w/o these issues. So maybe something changed or needed to that I wasn't aware of... ERRORS on some platforms (x86_64 clusters) : -- Build files have been written to: /home/jeg/cbtf/framework/build + make Scanning dependencies of target cbtf [ 3%] Building CXX object libcbtf/CMakeFiles/cbtf.dir/Component.cpp.o In file included from /opt/OSS202/include/boost/any.hpp:17:0, from /home/jeg/cbtf/framework/libcbtf/KrellInstitute/CBTF/Component.hpp:23, from /home/jeg/cbtf/framework/libcbtf/Component.cpp:21: /opt/OSS202/include/boost/type_traits/remove_reference.hpp:39:29: error: template argument 1 is invalid In file included from /opt/OSS202/include/boost/type_traits/is_reference.hpp:17:0, from /opt/OSS202/include/boost/any.hpp:18, from /home/jeg/cbtf/framework/libcbtf/KrellInstitute/CBTF/Component.hpp:23, from /home/jeg/cbtf/framework/libcbtf/Component.cpp:21: /opt/OSS202/include/boost/type_traits/is_rvalue_reference.hpp:21:1: error: template argument 1 is invalid In file included from /opt/OSS202/include/boost/type_traits/decay.hpp:14:0, from /opt/OSS202/include/boost/filesystem/v3/path_traits.hpp:22, from /opt/OSS202/include/boost/filesystem/v3/path.hpp:25, from /opt/OSS202/include/boost/filesystem.hpp:35, from /home/jeg/cbtf/framework/libcbtf/KrellInstitute/CBTF/Component.hpp:24, from /home/jeg/cbtf/framework/libcbtf/Component.cpp:21: /opt/OSS202/include/boost/type_traits/is_function.hpp:99:1: error: template argument 1 is invalid In file included from /opt/OSS202/include/boost/filesystem/v3/path.hpp:27:0, from /opt/OSS202/include/boost/filesystem.hpp:35, from /home/jeg/cbtf/framework/libcbtf/KrellInstitute/CBTF/Component.hpp:24, from /home/jeg/cbtf/framework/libcbtf/Component.cpp:21: ERRORS on another platform (Cray): - Configuring done -- Generating done -- Build files have been written to: /ccs/home/jgalaro/cbtf/framework/build + make Scanning dependencies of target cbtf [ 5%] Building CXX object libcbtf/CMakeFiles/cbtf.dir/Component.cpp.o [ 11%] Building CXX object libcbtf/CMakeFiles/cbtf.dir/ComponentImpl.cpp.o [ 17%] Building CXX object libcbtf/CMakeFiles/cbtf.dir/ResolvePath.cpp.o In file included from /ccs/home/jgalaro/oss_202_shared/include/boost/spirit/home/classic/core.hpp:28:0, from /ccs/home/jgalaro/oss_202_shared/include/boost/spirit/home/classic.hpp:24, from /ccs/home/jgalaro/cbtf/framework/libcbtf/ResolvePath.cpp:22: /ccs/home/jgalaro/oss_202_shared/include/boost/spirit/home/classic/core/match.hpp:18:69: fatal error: boost/spirit/home/classic/core/impl/match_attr_traits.ipp: No such file or directory compilation terminated. make[2]: *** [libcbtf/CMakeFiles/cbtf.dir/ResolvePath.cpp.o] Error 1 make[1]: *** [libcbtf/CMakeFiles/cbtf.dir/all] Error 2 make: *** [all] Error 2 + make install [ 5%] Building CXX object libcbtf/CMakeFiles/cbtf.dir/ResolvePath.cpp.o In file included from /ccs/home/jgalaro/oss_202_shared/include/boost/spirit/home/classic/core.hpp:28:0, from /ccs/home/jgalaro/oss_202_shared/include/boost/spirit/home/classic.hpp:24, from /ccs/home/jgalaro/cbtf/framework/libcbtf/ResolvePath.cpp:22: /ccs/home/jgalaro/oss_202_shared/include/boost/spirit/home/classic/core/match.hpp:18:69: fatal error: boost/spirit/home/classic/core/impl/match_attr_traits.ipp: No such file or directory compilation terminated. make[2]: *** [libcbtf/CMakeFiles/cbtf.dir/ResolvePath.cpp.o] Error 1 make[1]: *** [libcbtf/CMakeFiles/cbtf.dir/all] Error 2 make: *** [all] Error 2 + cd ../.. Thanks, Jim G.

1 1

[Chrono][System]:header only Boost.Chrono is not working with header only Boost.System
by Dmitriy Matison 06 Jul '12

06 Jul '12

Hi, On RHEL 5.5 Boost.Chrono 1.1.0 (Boost 1.47.0) fails to run in header only mode with header only Boost.System. This file can't be compiled: #define BOOST_SYSTEM_NO_DEPRECATED // without it also error, but in [Boost.System] #define BOOST_SYSTEM_INLINED #define BOOST_CHRONO_HEADER_ONLY #include <boost/chrono.hpp> int main() { boost::chrono::steady_clock::time_point start = boost::chrono::steady_clock::now(); return 0; } Error: In function `boost::chrono::steady_clock::now()': boost/chrono/detail/inlined/posix/chrono.hpp:85: undefined reference to `boost::system::system_category()' Any comments from Chrono\System guys? Thanks, Dmitriy.

3 6

boost::log & Visual Studio 2010 - problem with advanced event log backend.
by Konrad Rybacki 06 Jul '12

06 Jul '12

Hi All, I am trying to introduce boost::log into one of projects I am working on. The application already does some logging to the trace file and additionaly uses Windows Event Log to post messages. What I am going to do is to replace the existing logging framework with boost::log. Being frank - these are my first attempts at boost at all. I am following exactly the steps from the examples section of the documentation. I have written the following code: boost::shared_ptr< sinks::event_log_backend > backend( new sinks::event_log_backend(( keywords::message_file = "<path to library>.dll", keywords::log_name = "My Application", keywords::log_source = "My Source" )) ); sinks::event_log::event_composer composer( sinks::event_log::direct_event_id_mapping<int>("EventId") ); composer[MY_APPLICATION_SESSION_CREATION_FAILURE] % fmt::message(); backend->set_event_composer(composer); boost::shared_ptr<sinks::synchronous_sink< sinks::event_log_backend>> sink( new sinks::synchronous_sink< sinks::event_log_backend >(backend) ); sink->set_filter( (flt::attr<SeverityLevel>("Severity") == info || flt::attr<SeverityLevel>("Severity") == warning || flt::attr<SeverityLevel>("Severity") == error || flt::attr<SeverityLevel>("Severity") == fatal) && flt::has_attr<int>("EventId") ); sinks::event_log::custom_event_type_mapping<SeverityLevel> mapping("Severity"); mapping[trace] = sinks::event_log::info; mapping[debug] = sinks::event_log::info; mapping[info] = sinks::event_log::info; mapping[warning] = sinks::event_log::warning; mapping[error] = sinks::event_log::error; mapping[fatal] = sinks::event_log::error; sink->locked_backend()->set_event_type_mapper(mapping); logging::core::get()->add_sink(sink); I am building the code with Visual Studio 2010. Unfortunately I get the following error: 1>F:\boost\boost\boost/function/function_template.hpp(153): error C2064: term does not evaluate to a function taking 3 arguments 1> class does not define an 'operator()' or a user defined conversion operator to a pointer-to-function or reference-to-function that takes appropriate number of arguments 1> F:\boost\boost\boost/function/function_template.hpp(147) : while compiling class template member function 'void boost::detail::function::void_function_obj_invoker3<FunctionObj,R,T0,T1,T2>::invoke(boost::detail::function::function_buffer &,T0,T1,T2)' 1> with 1> [ 1> FunctionObj=boost::log_mt_nt5::formatters::fmt_message<char>, 1> R=void, 1> T0=std::basic_ostream<char,std::char_traits<char>> &, 1> T1=const boost::log_mt_nt5::basic_attribute_values_view<char> &, 1> T2=const std::basic_string<char,std::char_traits<char>,std::allocator<char>> & 1> ] 1> F:\boost\boost\boost/function/function_template.hpp(907) : see reference to class template instantiation 'boost::detail::function::void_function_obj_invoker3<FunctionObj,R,T0,T1,T2>' being compiled 1> with 1> [ 1> FunctionObj=boost::log_mt_nt5::formatters::fmt_message<char>, 1> R=void, 1> T0=std::basic_ostream<char,std::char_traits<char>> &, 1> T1=const boost::log_mt_nt5::basic_attribute_values_view<char> &, 1> T2=const std::basic_string<char,std::char_traits<char>,std::allocator<char>> & 1> ] 1> F:\boost\boost\boost/function/function_template.hpp(722) : see reference to function template instantiation 'void boost::function3<R,T0,T1,T2>::assign_to<Functor>(Functor)' being compiled 1> with 1> [ 1> R=void, 1> T0=std::basic_ostream<char,std::char_traits<char>> &, 1> T1=const boost::log_mt_nt5::basic_attribute_values_view<char> &, 1> T2=const std::basic_string<char,std::char_traits<char>,std::allocator<char>> &, 1> Functor=boost::log_mt_nt5::formatters::fmt_message<char> 1> ] 1> F:\boost\boost\boost/log/sinks/event_log_backend.hpp(678) : see reference to function template instantiation 'boost::function3<R,T0,T1,T2>::function3<FormatterT>(Functor,int)' being compiled 1> with 1> [ 1> R=void, 1> T0=std::basic_ostream<char,std::char_traits<char>> &, 1> T1=const boost::log_mt_nt5::basic_attribute_values_view<char> &, 1> T2=const std::basic_string<char,std::char_traits<char>,std::allocator<char>> &, 1> FormatterT=boost::log_mt_nt5::formatters::fmt_message<char>, 1> Functor=boost::log_mt_nt5::formatters::fmt_message<char> 1> ] 1> LoggingFacility.cpp(111) : see reference to function template instantiation 'boost::log_mt_nt5::sinks::event_log::basic_event_composer<CharT>::event_map_reference &boost::log_mt_nt5::sinks::event_log::basic_event_composer<CharT>::event_map_reference::operator %<boost::log_mt_nt5::formatters::fmt_message<CharT>>(const FormatterT &)' being compiled 1> with 1> [ 1> CharT=char, 1> FormatterT=boost::log_mt_nt5::formatters::fmt_message<char> 1> ] The problem seems to be caused by the following expression: composer[MY_APPLICATION_SESSION_CREATION_FAILURE] % fmt::message(); Other backends work flawlessly. Event log files (.h/.mc/.dll) are OK too. Any help? Regards, Konrad Rybacki.

1 0