- Boost-users - lists.boost.org

boost::wave::context deadlocks when called from a DLL
by Julien Lebot 24 Jun '12

24 Jun '12

Hi all, I'm having some issue with boost::wave::context: I have a function called PreProcessSource, which allocates a boost::wave::context and does some preprocessing; nothing fancy at all. std::string PreProcessSource(const std::string& instring, const std::string& defines) { typedef boost::wave::cpplexer::lex_token<> token_type; typedef boost::wave::cpplexer::lex_iterator<token_type> lex_iterator_type; typedef boost::wave::context<std::string::iterator, lex_iterator_type> context_type; std::string source = instring; context_type ctx(source.begin(), source.end()); // DEADLOCK here ctx.set_language(boost::wave::enable_emit_line_directives(ctx.get_language(), true)); if(!defines.empty()) { std::vector<std::string> tokens; Split<std::string>(defines, tokens, ","); std::vector<std::string>::const_iterator cit = tokens.begin(); for (;cit != tokens.end(); ++cit) ctx.add_macro_definition(*cit); } context_type::iterator_type first = ctx.begin(); context_type::iterator_type last = ctx.end(); std::string outstring; while (first != last) { const token_type::string_type& value = (*first).get_value(); std::copy(value.begin(), value.end(), std::back_inserter(outstring)); ++first; } return outstring; } In the past it used to work fine, albeit with boost 1.47.0: Library Nitro is a DLL that hosts the PreProcess source function, the executable uses the Nitro DLL and can call PreProcess source, and Nitro DLL can also sometimes call the function itself. But right now this is no longer the case: whenever Nitro DLL calls the function itself, or Nitro DLL calls another function, which in turn calls back into Nitro DLL PreProcess function, it deadlocks. If DO_DEADLOCK is defined to 1 in the following piece of code, the deadlock will happen: // In executable class Tutorial01 : public Game { public: // ... Tutorial01() : Game() { #if !DO_DEADLOCK std::stringstream sstream; sstream << "void main(inout float4 vtxInput : POSITION) { }" << std::endl << std::endl; std::string source = sstream.str(); std::string defines = ""; std::string shaderCode = Nitro::PreProcessSource(source, defines); #endif } void LoadContent() { #if DO_DEADLOCK std::stringstream sstream; sstream << "void main(inout float4 vtxInput : POSITION) { }" << std::endl << std::endl; std::string source = sstream.str(); std::string defines = ""; std::string shaderCode = Nitro::PreProcessSource(source, defines); #endif // Original code that deadlocks too. // Calls in the DLL, which will call PreProcessSource. // effect->Initialize(device, source, "DX11"); } // ... }; int APIENTRY wWinMain(HINSTANCE hInstance, HINSTANCE hPrevInstance, LPWSTR lpCmdLine, int nCmdShow) { Tutorial00 app; app.Run(); return 0; } Note that the constructor is called directly from the executable, whereas LoadContent is called from the DLL: // In Nitro DLL void Game::Run() { try { // ... LoadContent(); // ... } catch(/* ... */) { } } The code is compiled for x64 and in debug mode. I compile boost myself into a DLL (using bcp to get the files for the libraries I use) with the following options: Preprocessor: WIN32 BOOST_ALL_NO_LIB BOOST_ALL_DYN_LINK BOOST_THREAD_BUILD_DLL _DLL _DEBUG _WINDOWS _USRDLL Code Generation: C++ Exceptions (/EHsc) Multi-threaded Debug DLL (/MDd) Function-level linking (/Gy) Streaming SIMD Extensions 2 (/arch:SSE2) (/arch:SSE2) Fast floating point model (/fp:fast) DLL A uses the same code gen options, and has the following preprocessor macros defined: _WINDLL _UNICODE UNICODE WIN32 _WINDOWS BOOST_ALL_NO_LIB _DEBUG The executable and unit test executable uses the same code gen options, and have the following preprocessor macros defined: BOOST_ALL_NO_LIB UNICODE _UNICODE _MBCS I have tried various combinations of preprocessor definitions (with _DEBUG and without, with BOOST_THREAD_USE_DLL, and without; to no avail). Here is the (cleaned up) stack trace of the deadlock: ntdll.dll!0000000076dc135a() [Frames below may be incorrect and/or missing, no symbols loaded for ntdll.dll] KernelBase.dll!000007fefd4f10dc() Nitro.dll!boost::call_once<void (__cdecl*)(void)>(boost::once_flag & flag, void (void)* f) Line 197 + 0x18 bytes C++ Nitro.dll!boost::call_once(void (void)* func, boost::once_flag & flag) Line 28 C++ Nitro.dll!boost::spirit::classic::static_<boost::thread_specific_ptr<boost::weak_ptr<boost::spirit::classic::impl::grammar_helper ... Line 72 + 0x13 bytes C++ Nitro.dll!boost::spirit::classic::impl::get_definition<boost::wave::util::time_conversion::time_conversion_grammar, ... Line 241 + 0x17 bytes C++ Nitro.dll!boost::spirit::classic::impl::grammar_parser_parse<0,boost::wave::util::time_conversion::time_conversion_grammar, ... Line 296 + 0xa bytes C++ Nitro.dll!boost::spirit::classic::grammar<boost::wave::util::time_conversion::time_conversion_grammar, ... Line 55 + 0x3c bytes C++ Nitro.dll!boost::spirit::classic::grammar<boost::wave::util::time_conversion::time_conversion_grammar, ... Line 65 + 0x75 bytes C++ Nitro.dll!boost::spirit::classic::impl::phrase_parser<boost::spirit::classic::space_parser>::parse<char const * __ptr64,boost::wave::util::time_conversion::time_conversion_grammar> ... Line 136 C++ Nitro.dll!boost::spirit::classic::parse<char const * __ptr64,boost::wave::util::time_conversion::time_conversion_grammar, ... Line 155 + 0x3a bytes C++ Nitro.dll!boost::spirit::classic::parse<char,boost::wave::util::time_conversion::time_conversion_grammar, ... Line 173 + 0x23 bytes C++ Nitro.dll!boost::wave::util::time_conversion::time_conversion_helper::time_conversion_helper(const char * act_time) Line 123 C++ Nitro.dll!boost::wave::util::predefined_macros::predefined_macros() Line 196 + 0x38 bytes C++ ... Nitro.dll!Nitro::PreProcessSource(const std::basic_string<char,std::char_traits<char>,std::allocator<char> > & instring, const std::basic_string<char,std::char_traits<char>,std::allocator<char> > & defines) Line 51 + 0xa0 bytes C++ Tutorial01.exe!Tutorial01::LoadContent() Line 70 + 0x33 bytes C++ Nitro.dll!Nitro::Game::Run() Line 40 C++ Tutorial01.exe!wWinMain(HINSTANCE__ * hInstance, HINSTANCE__ * hPrevInstance, wchar_t * lpCmdLine, int nCmdShow) Line 149 C++ Tutorial01.exe!__tmainCRTStartup() Line 547 + 0x42 bytes C Tutorial01.exe!wWinMainCRTStartup() Line 371 C kernel32.dll!00000000766a652d() ntdll.dll!0000000076d9c521() It seems boost::wave is trying to parse some time stamp, and by doing so instantiates a grammar and that's when things seem to go bad. The deadlock happens inside the constructor of the context type, and the Visual Studio debugger points me to line 197 in boost\thread\win32\once.hpp BOOST_VERIFY(!::boost::detail::win32::WaitForSingleObject( event_handle,::boost::detail::win32::infinite)); When called directly from the executable, I have noticed that the once_flag.status value is 0, and it exits the loop on the first iteration, whereas when it's called from inside the DLL, the once_flag.status value is 53, and it goes around the loop twice before falling into the WaitForSingleObject. I'm not sure if that's even relevant but I've exhausted all the possibilities and I'm out of ideas. I'd be grateful if anyone could shed some light on this. Best Regards, Julien Lebot

2 3

issue about include boost thread header in MFC dll
by young 24 Jun '12

24 Jun '12

I have a MFC dll application. I try to use Boost thread in the dll. #include "stdafx.h" #include "interface.h" #include "MFCDLL.h" #include <boost/thread.hpp> // The one and only CMFCDLLApp object CMFCDLLApp theApp; EXPORT32 int __stdcall func() { AFX_MANAGE_STATE(AfxGetStaticModuleState()); ... return DLL_OK; } The build is OK. But when I call the func, it crashes. If I comment the line: //#include <boost/thread.hpp> Then it works well. So how to use thread in MFC dll? -- View this message in context: http://boost.2283326.n4.nabble.com/issue-about-include-boost-thread-header-… Sent from the Boost - Users mailing list archive at Nabble.com.

3 5

Filesystem: Choose random file from directory
by Andrej van der Zee 23 Jun '12

23 Jun '12

Hi, I have a directory with about 500.000 thousand small files in it. I need to randomly select one of those file. What would be the *most efficient* way to achieve this? Thank you, Andrej

4 4

[serialization] mingw Deriving from boost::archive::xml_iarchive
by Ken 23 Jun '12

23 Jun '12

Hi, We have a boost archive class derived from boost::archive::xml_iarchive_impl, like this: class XmlInputArchive : public boost::archive::xml_iarchive_impl< XmlInputArchive >, public boost::archive::detail::shared_ptr_helper Its purpose is to provide diagnostics information when deserialising xml archive input, ie. which tag is failing. In porting from 1_41 to 1_49 on mingw this no longer links because the boost::archive::basic_xml_grammar<char> class's symbols are no longer exported from the serialization library. The functions this class overrides are the protected functions: void load_start( const char * name ); void load_end( const char * name ); The existing boost::archive::xml_iarchive class derives from xml_iarchive_impl, and as these functions are protected in the latter, they are not available to a class derived from boost::archive::xml_iarchive class directly. And, for the same reason, we can't create an archive class that delegates to a boost::archive::xml_iarchive instance. So neither deriving from boost::archive::xml_iarchive nor using one as a delegate are feasible solutions. Is there a way of creating an xml_iarchive class that has access to the load_start, load_end functions? Or perhaps there is another way to get the diagnostics information about which xml tags are being processed? Thanks, Ken Appleby

2 2

Advance usage of mutil index,need help.
by 张大千 23 Jun '12

23 Jun '12

this is the story: suppose you have some files(files1,files2,files3) and some usergroup(ug1,ug2,ug3). and this is the struct file{ string name; set<string> group; } and file1.name = "file1"; file1.group.insert("ug1"); file1.group.insert("ug2"); file1.group.insert("ug3"); file2.name = "file2"; file2.group.insert("ug2"); file3.name = "file3"; file3.group.insert("ug3"); and i need search by file name or group, and file name should can be support fuzzy search (eg. *ile , *1 ....) can boost mutil index do this,if can ,what kind index need? or there is other way to do this?

1 0

[serialization] mingw linker problems
by Ken 23 Jun '12

23 Jun '12

Hi, We have an application comprised of many shared libraries. It is built on Windows using mingw (gcc 4.4) and on Mac OS X using gcc under the Qt 4.7.0 framework. The application has been based on boost 1_41. We are now attempting to port to boost 1_49. We use boost.serialization and other boost libraries as dlls. On Mac OS X the upgrade was mostly trouble free, but with mingw we have encountered problems with all of our libraries that use boost.serialization. Basically, the inclusion of boost.serialization code appears to alter the default symbol visibility of the dlls generated by mingw. Each of our libraries consists of a declaration of a class, with public functions, and zero or more free functions. If the library implementation includes boost.archive or boost.serialization the public functions of the class, and any free functions declared, are missing from the import library, though visible in the dll. Each of our libraries has a test executable, and with many it is a trivial task to comment out the use of boost.serialization in the library and test code. When we do that, there are no linker problems. As soon as we reintroduce functions that use boost.serialization into the library, the test function fails to find the public functions of the library class. Please can anyone explain this? How does the use of boost.serialization change the global behaviour of mingw gcc in generating dll import libraries? TIA Ken Appleby

2 2

[phoenix] passing values
by Karsten Ahnert 23 Jun '12

23 Jun '12

Hi, I figured out that argument deduction in phoenix only works with references, so the following will not compile: std::cout << arg1( 1.0 ) << std::endl; Are there any alternatives to use use phoenix directly with values?

2 1

[mpl] Documentation suggestion
by Jeremiah Willcock 22 Jun '12

22 Jun '12

I have noticed that several MPL algorithms do not work when applied to views unless an output iterator (inserter) is passed in explicitly. The error messages when you hit one of those cases are very non-obvious, however. It might be nice to have something in the documentation that talks about this issue and the workarounds for it. Here is an example of something that breaks: #include <boost/mpl/vector_c.hpp> #include <boost/mpl/joint_view.hpp> #include <boost/mpl/sort.hpp> #include <boost/mpl/print.hpp> typedef boost::mpl::vector_c<int, 2, 0> va; typedef boost::mpl::vector_c<int, 1, 3, -1, 5> vb; typedef boost::mpl::joint_view<va, vb> vc; typedef boost::mpl::sort<vc>::type vd; The first important part of the error message with GCC 4.7.0 in C++11 mode is: .../boost-svn/boost/mpl/clear.hpp: In instantiation of ‘struct boost::mpl::clear<boost::mpl::joint_view<boost::mpl::vector_c<int, 2l, 0l>, boost::mpl::vector_c<int, 1l, 3l, -1l, 5l> > >’: .../boost-svn/boost/mpl/sort.hpp:23:1: required from ‘struct boost::mpl::sort<boost::mpl::joint_view<boost::mpl::vector_c<int, 2l, 0l>, boost::mpl::vector_c<int, 1l, 3l, -1l, 5l> > >’ mpl_test.cpp:9:29: required from here .../boost-svn/boost/mpl/clear.hpp:28:8: error: invalid use of incomplete type ‘struct boost::mpl::clear_impl<boost::mpl::aux::joint_view_tag>::apply<boost::mpl::joint_view<boost::mpl::vector_c<int, 2l, 0l>, boost::mpl::vector_c<int, 1l, 3l, -1l, 5l> > >’ which seems to indicate that the default inserter needs a "real" container as input to the algorithm in order to know what container to use for the result. Since this limitation is probably unavoidable, some kind of note in the documentation might be useful. Thanks. -- Jeremiah Willcock

2 1

Arguments types for object created with boost::bind()
by niXman 21 Jun '12

21 Jun '12

Hello! I need to get the types list for operator() for result type of boost::bind() Example: void func(int, long) {} auto o = boost::bind(&func, _1, _2); o( ??? ); // what types of arguments? Thanks. -- Regards, niXman ___________________________________________________ Dual-target(32 & 64 bit) MinGW compilers for 32 and 64 bit Windows: http://sourceforge.net/projects/mingwbuilds/

3 3

boost.log on Windows with MingGW
by Konstantin Ribel 21 Jun '12

21 Jun '12

1 0