[Boost-bugs] [Boost C++ Libraries] #6024: Behaviour and documentation don't match

Subject: [Boost-bugs] [Boost C++ Libraries] #6024: Behaviour and documentation don't match
From: Boost C++ Libraries (noreply_at_[hidden])
Date: 2011-10-14 07:33:14

#6024: Behaviour and documentation don't match
------------------------------------------------------+---------------------
 Reporter:  Olaf van der Spek <olafvdspek@…>          |       Owner:  jsiek    
     Type:  Bugs                                      |      Status:  new      
Milestone:  To Be Determined                          |   Component:  tokenizer
  Version:  Boost 1.47.0                              |    Severity:  Problem  
 Keywords:                                            |  
------------------------------------------------------+---------------------
 Hi,

 > explicit char_separator()

 Explicit? Doesn't explicit only apply to one argument constructors?

 > The function std::isspace() is used to identify dropped delimiters and
 std::ispunct() is used to identify kept delimiters. In addition, empty
 tokens are dropped.

  std::string s("[1][3][5][]9");
  BOOST_FOREACH(auto i, boost::tokenizer<>(s))
    std::cout << i << std::endl;

 This outputs only numbers. Shouldn't the brackets be included too?

-- 
Ticket URL: <https://svn.boost.org/trac/boost/ticket/6024>
Boost C++ Libraries <http://www.boost.org/>
Boost provides free peer-reviewed portable C++ source libraries.