[boost] [tokenizer] default tokenizer function

From: Vladimir Prus (ghost_at_[hidden])
Date: 2004-07-30 04:43:20

The current CVS still has char_delimiter_separator as default tokenizer 
function, while documentation says that class is deprecated.

Any chance this will be fixed? It's very weird, and I'd also prefer 
escaped_list_separator to be default.

(I know string_algo has splitter too, but for now it does not work on all 
compilers where program_options work -- for example, borland and intel 7.1)

- Volodya