[boost] Tokenizer docs: bug?

Subject: [boost] Tokenizer docs: bug?
From: Olaf van der Spek (ml_at_[hidden])
Date: 2011-10-03 11:53:00

Hi,

> explicit char_separator()

Explicit? Doesn't explicit only apply to one argument constructors?

> The function std::isspace() is used to identify dropped delimiters and std::ispunct() is used to identify kept delimiters. In addition, empty tokens are dropped.

  std::string s("[1][3][5][]9");
  BOOST_FOREACH(auto i, boost::tokenizer<>(s))
    std::cout << i << std::endl;

This outputs only numbers. Shouldn't the brackets be included too?

Olaf