- Boost-users - lists.boost.org

asio tcp async_read never returns
by Tom Kent 10 Mar '10

10 Mar '10

I am trying to convert some existing code to use boost's asio tcp sockets instead of our current implementation. I am able to get a very similar example (of a chat client/server) from the boost site working, but when I attempt to put the code into my own program it stops working. What I am doing: 1. Start a server process 2. The server process makes an empty socket and uses it to listen (with a tcp::acceptor) for TCP connections on a port (10010 for example) 3. Start a client process 4. Have the client process create a socket connect to the server's port 5. When the server sees a client is connecting, it starts listening for data(with async_read) on the socket and creates another empty socket to listen for another TCP connection on the port 6. When the client sees that the server has connected, it sends 100 bytes of data (with async_write) and waits for the socket to tell it the send is finished...when that happens it prints a message and shuts down 7. When the server gets notified that its has data that has been read, it prints a message and shuts down Obviously, I have greatly trimmed this code down from what I'm trying to implement, this is as small as I could make something that reproduces the problem. I'm running on windows and have a visual studio solution file you can get (http://boost.teeks99.com/BoostConnectionTest.zip) There's some memory leaks, thread safety problems, and such, but that's because I'm taking stuff out of existing code, so don't worry about them. Anyway, here's the files one header with some common stuff, a server, and a client. Connection.hpp: #ifndef CONNECTION_HPP #define CONNECTION_HPP #include <boost/system/error_code.hpp> #include <boost/asio.hpp> #include <boost/bind.hpp> class ConnectionTransfer { public: ConnectionTransfer(char* buffer, unsigned int size) : buffer_(buffer), size_(size) { } virtual ~ConnectionTransfer(void){} char* GetBuffer(){return buffer_;} unsigned int GetSize(){return size_;} virtual void CallbackForFinished() = 0; protected: char* buffer_; unsigned int size_; }; class ConnectionTransferInProgress { public: ConnectionTransferInProgress(ConnectionTransfer* ct): ct_(ct) {} ~ConnectionTransferInProgress(void){} void operator()(const boost::system::error_code& error){Other(error);} void Other(const boost::system::error_code& error){ if(!error) ct_->CallbackForFinished(); } private: ConnectionTransfer* ct_; }; class Connection { public: Connection(boost::asio::io_service& io_service): sock_(io_service) {} ~Connection(void){} void AsyncSend(ConnectionTransfer* ct){ ConnectionTransferInProgress tip(ct); //sock_->async_send(boost::asio::buffer(ct->GetBuffer(), // static_cast<std::size_t>(ct->GetSize())), tip); boost::asio::async_write(sock_, boost::asio::buffer(ct->GetBuffer(), static_cast<std::size_t>(ct->GetSize())), boost::bind( &ConnectionTransferInProgress::Other, tip, boost::asio::placeholders::error)); } void AsyncReceive(ConnectionTransfer* ct){ ConnectionTransferInProgress tip(ct); //sock_->async_receive(boost::asio::buffer(ct->GetBuffer(), // static_cast<std::size_t>(ct->GetSize())), tip); boost::asio::async_read(sock_, boost::asio::buffer(ct->GetBuffer(), static_cast<std::size_t>(ct->GetSize())), boost::bind( &ConnectionTransferInProgress::Other, tip, boost::asio::placeholders::error)); } boost::asio::ip::tcp::socket& GetSocket(){return sock_;} private: boost::asio::ip::tcp::socket sock_; }; #endif //CONNECTION_HPP BoostConnectionClient.cpp: #include "Connection.hpp" #include <boost/asio.hpp> #include <boost/bind.hpp> #include <boost/thread.hpp> #include <iostream> using namespace boost::asio::ip; bool connected; bool gotTransfer; class FakeTransfer : public ConnectionTransfer { public: FakeTransfer(char* buffer, unsigned int size) : ConnectionTransfer(buffer, size) { } void CallbackForFinished() { gotTransfer = true; } }; void ConnectHandler(const boost::system::error_code& error) { if(!error) connected = true; } int main(int argc, char* argv[]) { connected = false; gotTransfer = false; boost::asio::io_service io_service; Connection* conn = new Connection(io_service); tcp::endpoint ep(address::from_string("127.0.0.1"), 10011); conn->GetSocket().async_connect(ep, ConnectHandler); boost::thread t(boost::bind(&boost::asio::io_service::run, &io_service)); while(!connected) { boost::this_thread::sleep(boost::posix_time::millisec(1)); } std::cout << "Connected\n"; char data[100]; FakeTransfer* ft = new FakeTransfer(data, 100); conn->AsyncReceive(ft); while(!gotTransfer) { boost::this_thread::sleep(boost::posix_time::millisec(1)); } std::cout << "Done\n"; return 0; } BoostConnectionServer.cpp: #include "Connection.hpp" #include <boost/asio.hpp> #include <boost/bind.hpp> #include <boost/thread.hpp> #include <iostream> using namespace boost::asio::ip; Connection* conn1; bool conn1Done; bool gotTransfer; Connection* conn2; class FakeAcceptor { public: FakeAcceptor(boost::asio::io_service& io_service, const tcp::endpoint& endpoint) : io_service_(io_service), acceptor_(io_service, endpoint) { conn1 = new Connection(io_service_); acceptor_.async_accept(conn1->GetSocket(), boost::bind(&FakeAcceptor::HandleAccept, this, conn1, boost::asio::placeholders::error)); } void HandleAccept(Connection* conn, const boost::system::error_code& error) { if(conn == conn1) conn1Done = true; conn2 = new Connection(io_service_); acceptor_.async_accept(conn2->GetSocket(), boost::bind(&FakeAcceptor::HandleAccept, this, conn2, boost::asio::placeholders::error)); } boost::asio::io_service& io_service_; tcp::acceptor acceptor_; }; class FakeTransfer : public ConnectionTransfer { public: FakeTransfer(char* buffer, unsigned int size) : ConnectionTransfer(buffer, size) { } void CallbackForFinished() { gotTransfer = true; } }; int main(int argc, char* argv[]) { boost::asio::io_service io_service; conn1Done = false; gotTransfer = false; tcp::endpoint endpoint(tcp::v4(), 10011); FakeAcceptor fa(io_service, endpoint); boost::thread t(boost::bind(&boost::asio::io_service::run, &io_service)); while(!conn1Done) { boost::this_thread::sleep(boost::posix_time::millisec(1)); } std::cout << "Accepted incoming connection\n"; char data[100]; FakeTransfer* ft = new FakeTransfer(data, 100); conn1->AsyncReceive(ft); while(!gotTransfer) { boost::this_thread::sleep(boost::posix_time::millisec(1)); } std::cout << "Success!\n"; return 0; } I've searched around a bit, but haven't had much luck. As far as I can tell, I'm almost exactly matching the sample, so it must be something small that I'm overlooking. Any help is much appreciated! Tom P.S. cross posted to stack overflow: http://stackoverflow.com/questions/2412520/

2 1

problem with gather array
by alev mutlu 09 Mar '10

09 Mar '10

Hi I am trying to scatter some values to workers and then gather them. But I get strange error in gather step. Any suggestions? Below is the code and error file. //mpicxx test-boost.cpp -o test-boost -I /home1/mutlu/boost/include/boost-1_37/ /home1/mutlu/boost/lib/libboost_mpi-gcc41-mt-1_37.a #include <boost/mpi/environment.hpp> #include <boost/mpi/communicator.hpp> #include <boost/mpi/collectives.hpp> #include <boost/thread/mutex.hpp> #include <iostream> #include <vector> #define MASTER 0 namespace mpi = boost::mpi; using namespace std; struct x{ string name; int age; }; int arraySize = 23; void silly_func(int *px, int sz){ for(int i = 0; i < sz; i++) px[i] = 100; } int main(int argc, char* argv[]) { mpi::environment env(argc, argv); mpi::communicator world; int m_mySize, w_mySize, kk,i; int *myValues; vector<int> a; vector<int> aa; for(int i = 0; i < arraySize; i++) a.push_back(i); w_mySize = arraySize / world.size(); if (world.rank() == MASTER){ m_mySize = arraySize / world.size() + arraySize % world.size(); myValues = (int *) malloc(m_mySize); } else{ myValues = (int *) malloc(w_mySize); } if (world.rank() == MASTER) scatter(world, a, myValues, w_mySize, 0); else scatter(world, a, myValues, w_mySize, 0); if (world.rank() == MASTER) // append the remaining elements { for (i = w_mySize * world.size(), kk = 0; i < arraySize; i++, kk++) myValues[w_mySize + kk] = a[w_mySize * world.size() + kk]; } cout << "my rank is " << world.rank() << " and my values are" << endl; if (world.rank() == MASTER) for (int i = 0; i < m_mySize; i++) cout << myValues[i] << endl; if (world.rank() != MASTER) for (int i = 0; i < w_mySize; i++) cout << myValues[i] << endl; if (world.rank() != MASTER) silly_func(myValues, w_mySize); else silly_func(myValues, m_mySize); if (world.rank() == MASTER) gather(world, myValues, m_mySize, aa, 0); else gather(world, myValues, w_mySize, aa, 0); if (world.rank() == MASTER){ cout << "======================="<< endl; for(int i = 0; i < aa.size(); i++) cout << aa[i] << endl; } } and error file is [ceng3:23784] *** Process received signal *** [ceng3:23784] Signal: Segmentation fault (11) [ceng3:23784] Signal code: Address not mapped (1) [ceng3:23784] Failing at address: (nil) [ceng3:23784] [ 0] /lib64/libpthread.so.0 [0x30e100de80] [ceng3:23784] [ 1] /lib64/libc.so.6(memcpy+0x37) [0x30e047a107] [ceng3:23784] [ 2] /usr/mpi/gcc/openmpi-1.2.8/lib64/libmpi.so.0(ompi_ddt_copy_content_same_ddt+0xe8) [0x2b180e3b5618] [ceng3:23784] [ 3] /usr/mpi/gcc/openmpi-1.2.8/lib64/libmpi.so.0(ompi_ddt_sndrcv+0x3f3) [0x2b180e3b3ef3] [ceng3:23784] [ 4] /usr/mpi/gcc/openmpi-1.2.8/lib64/openmpi/mca_coll_basic.so(mca_coll_basic_gather_intra+0xd2) [0x2b18142f20a2] [ceng3:23784] [ 5] /usr/mpi/gcc/openmpi-1.2.8/lib64/libmpi.so.0(PMPI_Gather+0x19b) [0x2b180e3c7ccb] [ceng3:23784] [ 6] test-boost(_ZN5boost3mpi6detail11gather_implIiEEvRKNS0_12communicatorEPKT_iPS6_iN4mpl_5bool_ILb1EEE+0x6b) [0x414b29] [ceng3:23784] [ 7] test-boost(_ZN5boost3mpi6gatherIiEEvRKNS0_12communicatorEPKT_iPS5_i+0x50) [0x414c82] [ceng3:23784] [ 8] test-boost(_ZN5boost3mpi6gatherIiEEvRKNS0_12communicatorEPKT_iRSt6vectorIS5_SaIS5_EEi+0x42) [0x414ce8] [ceng3:23784] [ 9] test-boost(main+0x342) [0x40f62c] [ceng3:23784] [10] /lib64/libc.so.6(__libc_start_main+0xf4) [0x30e041d8b4] [ceng3:23784] [11] test-boost(__gxx_personality_v0+0x141) [0x40f199] [ceng3:23784] *** End of error message *** mpirun noticed that job rank 0 with PID 23784 on node ceng3-ib exited on signal 11 (Segmentation fault).

2 3

[iostreams] State of a filtering stream
by Nicola 09 Mar '10

09 Mar '10

Hi, I have implemented a filtering stream for decompressing bzipped files, which looks as shown at the end of the message. I have tried to use it like this: bz2istream bzippedfile("myfile.bz2"); while (bzippedfile >> data) { // process data } but the program enters an endless loop. The only way I can test for the end of file is with: while (bzippedfile.peek() != EOF) { bzippedfile >> data; // process data } Isn't the first method supposed to work? Is my class missing something? Regards Nicola class bz2istream : public boost::iostreams::filtering_stream<boost::iostreams::input> { public: bz2istream(std::string const& path) : ff_(path.c_str(), std::ios_base::in | std::ios_base::binary) { if (ff_.fail()) { // Here we are not distinguishing failbit from badbit... setstate(std::ios_base::failbit); } else { push(boost::iostreams::bzip2_decompressor()); push(ff_); } } private: std::ifstream ff_; };

1 0

Skipper in rules (Spirit)
by Xavier Pegenaute 09 Mar '10

09 Mar '10

Hi, I am trying to create some rule to parse some words until the end of line. To do it I thought to use a phrase_parser and put in the SkipT parameter something like "space - eol". The problem is that seems the SkipT parameter only accepts the space rule. error: no match for call to ‘.... const boost::spirit::qi::difference<boost::spirit::qi::char_class<boost::spirit::tag::char_code<boost::spirit::tag::space, boost::spirit::char_encoding::ascii> >, boost::spirit::qi::eol_parser> note: candidates are: .... const boost::spirit::qi::char_class<boost::spirit::tag::char_code<boost::spirit::tag::space, boost::spirit::char_encoding::ascii> > In the classic spirit I know it was possible to define. May be I should change the point of view for this new version? how I should deal with it? Thanks & Regards. Xavi.

2 1

boost serialisation: portable binary format cant cope with -1
by Avi Bahra 09 Mar '10

09 Mar '10

I have a strange bug where on the AIX platform I get: boost::archive exception for TimeStruct : integer cannot be represented for boost version 1.40 on restoring a class(TimeStruct) that has a integer data member of value of -1. Its seems strange that the exception is _only_ raised when restoring the class, and not saving Its missing some symmetry somewhere ? Here is the stack trace: //boost::serialization::throw_exception<portable_binary_iarchive_exception>, //portable_binary_iarchive::load_impl, //portable_binary_iarchive::load<int>, //boost::archive::load_access::load_primitive<portable_binary_iarchive,int>, //boost::archive::detail::load_non_pointer_type<portable_binary_iarchive,int>::load_primitive::invoke, //boost::archive::detail::load_non_pointer_type<portable_binary_iarchive,int>::invoke, //boost::archive::load<portable_binary_iarchive,int>, //boost::archive::detail::common_iarchive<portable_binary_iarchive>::load_override<int>, //portable_binary_iarchive::load_override<int>, //boost::archive::detail::interface_iarchive<portable_binary_iarchive>::operator >><int>, //boost::archive::detail::interface_iarchive<portable_binary_iarchive>::operator &<int>, //TimeStruct::serialize<portable_binary_iarchive>, // ..... This is raised in: void portable_binary_iarchive::load_impl(boost::intmax_t & l, char maxsize){ char size; l = 0; this->primitive_base_t::load(size); if(0 == size){ return; } bool negative = (size < 0); if(negative) size = -size; if(size > maxsize) boost::serialization::throw_exception( portable_binary_iarchive_exception() ); ..... The exception is raised because size=255 and maxsize=4 ? Here is the example which produces the exception: Please note that you will have to dig out and compile the portable binary archives out of the boost serialisation examples dirs. //================ Main.cpp ========================= // This example demonstrates a possible bug in // portable binary format on AIX when serialising -1 // that is specific only to the AIX compiler/platform // (i.e HPUX/Acc and linux/gcc run without any problems) // However on AIX on the restore I get: // boost::archive exception for TimeStruct : integer cannot be represented // // This test consists of 1 files // 1/ Main.cpp // #include <sstream> #include <ostream> #include <iostream> #include <fstream> #include <boost/archive/binary_oarchive.hpp> #include <boost/archive/binary_iarchive.hpp> #include <boost/archive/text_iarchive.hpp> #include <boost/archive/text_oarchive.hpp> #include "portable_binary_oarchive.hpp" #include "portable_binary_iarchive.hpp" #include <boost/serialization/serialization.hpp> using namespace std; class TimeStruct { public: TimeStruct() : hour_(-1), minute_(-1) {} TimeStruct(int hour, int min) : hour_(hour), minute_(min) {} bool operator==(const TimeStruct& rhs) const { return ((hour_ == rhs.hour_) && (minute_ == rhs.minute_));} bool operator!=(const TimeStruct& rhs) const { return !operator==(rhs);} int hour() const { return hour_;} int minute() const { return minute_;} bool isNULL() const { return (hour_ == -1) || (minute_ == -1); } // returns struct in the format hh:mm std::string toString() const { std::stringstream ss; if (hour_ == -1) ss << hour_; else if (hour_ < 10) ss << "0" << hour_; else ss << hour_; ss << ":"; if (minute_ == -1) ss << minute_; else if (minute_ < 10) ss << "0" << minute_; else ss << minute_; return ss.str(); } private: int hour_; int minute_; friend class boost::serialization::access; template<class Archive> void serialize(Archive & ar, const unsigned int /*version*/) { ar & hour_; ar & minute_; } }; bool compare(const TimeStruct& lhs, const TimeStruct& rhs) { if (lhs.isNULL() && rhs.isNULL()) return true; if (lhs.isNULL() && !rhs.isNULL()) return false; if (!lhs.isNULL() && rhs.isNULL()) return false; if (lhs.hour() != rhs.hour()) return false; if (lhs.minute() != rhs.minute()) return false; return true; }; static void save(const std::string& fileName, const TimeStruct& ts, bool textArchive); static void restore(const std::string& fileName, TimeStruct& ts, bool textArchive); int main() { { TimeStruct saved; save("fred.txt",saved,true); TimeStruct restored; restore("fred.txt",restored,true); assert(saved == restored); } { TimeStruct saved; save("fred.txt",saved,false); TimeStruct restored; restore("fred.txt",restored,false); assert(saved == restored); } return 0; } void save(const std::string& fileName, const TimeStruct& ts, bool textArchive) { if ( textArchive ) std::cout << "Text archive Saving " << ts.toString(); else std::cout << "portable binary archive Saving " << ts.toString(); try { if (textArchive) { std::ofstream ofs( "fred.txt" ); boost::archive::text_oarchive ar( ofs ); ar << ts; } else { std::ofstream ofs( fileName.c_str(), ios::binary ); portable_binary_oarchive ar(ofs); ar << ts; } std::cout << " OK \n"; } catch (const boost::archive::archive_exception& ae) { std::cout << " save " << fileName << " failed. boost::archive exception for TimeStruct " << ": " << ae.what() << std::endl; } } void restore(const std::string& fileName, TimeStruct& restored, bool textArchive) { if ( textArchive ) std::cout << "Text archive Restoring "; else std::cout << "portable binary archive Restoring " ; try { if ( textArchive ) { std::ifstream ifs( fileName.c_str() ); boost::archive::text_iarchive ar( ifs ); ar >> restored; } else { std::ifstream ifs( fileName.c_str(), ios::binary ); portable_binary_iarchive ar( ifs ); ar >> restored; } std::cout << restored.toString() << " OK \n"; } catch ( const boost::archive::archive_exception& ae ) { std::cout << " restore " << fileName << " failed. boost::archive exception for TimeStruct " << ": " << ae.what() << std::endl; } } Best regards, Ta, Avi

1 0

[Boost.Log] Did I miss the formal review start mail?
by Roland Bock 09 Mar '10

09 Mar '10

Hi, a week ago, Vladimir wrote that a formal review of boost.log would start this week. Did I miss the formal mail? Thanks and regards, Roland

4 6

[filesystem] basic_path as parameter
by Alexander Lamaison 09 Mar '10

09 Mar '10

I'd like to use basic_path as a function parameter so that it works correctly whether a wide or narrow string is passed. template<typename T> void func(basic_path<T> file) { do thing to file } func("myfile"); func(L"myfile"); However I can't do this because basic_path has a second Traits template parameter which is not itself a template. So I tried the following workaround: template<typename T> struct traits_chooser; template<> struct traits_chooser<char*> { typedef boost::filesystem::path_traits traits; }; template<> struct traits_chooser<wchar_t*> { typedef boost::filesystem::wpath_traits traits; }; template<typename T> void func(basic_path<T, typename traits_chooser<T>::traits> file) {...} But my compiler (MSVC 2005) still can't deduce the parameter type. Does anyone know how I can get this to work? Many thanks. Alex Lamaison

1 0

[boost::asio] exception not passed to async callback
by Matheus Araújo Aguiar 09 Mar '10

09 Mar '10

Hello list, Right now i am having some problems with a TCP socket waiting for a pending async read operation. When the remote endpoint closes the connection due to some crash or other unexpected situation(i.e, without proper closing of the socket) my application is terminated with this message: "Terminate called after throwing an instance of 'boost::exception_detail::clone_impl<boost::exception_detail::error_info_injector<boost::system::system_error> >' what(): Transport endpoint is not connected Aborted" Maybe i am missing something here, because i expected any boost::system exceptions to be passed to the callback associated with the async read operation. I am assuming that this exception is thrown in the io_service::run method, is that right? If so, why it is not passed to the callback? and what can i do to catch it, having the io_service::run running on a separeted thread? Thanx in advance and best regards, -- Matheus Araújo Aguiar Computer Scientist matheus.pit(a)gmail.com

2 2

Boost.Random question
by gast128 09 Mar '10

09 Mar '10

Hello all, a colleague of my asked me to drop a question on the forum about the following case: He produces 1000 samples with the following code: boost::normal_distribution<double> n1(1, sqrt(4.0)); boost::variate_generator< boost::minstd_rand, boost::normal_distribution<double> > g1(boost::minstd_rand(), n1); He also calulates the covariance. It should be something like (4 0) but he got (4.1 8.3). This 4 is correct, but the 8.3 not. Anyone an idea? Note (again): post from a colleague; i didn't try it myself.

2 2

Boost.Asio tcp::acceptor after close, then open->listen got error!!!!
by l.jay Yuan 09 Mar '10

09 Mar '10

Boost.Asio tcp::acceptor after close, then open->listen got error!!!! cannot reopen?

2 2