Re: Tokenizer status

From: jbandela_at_[hidden]
Date: 2001-12-03 00:02:09

Gennadiy,

I just checked a version of token_functions into the CVS. This version
uses tok.assign in offset_separator and char_delimiters_separator 
when the iterator is not an input iterator. Otherwise it uses tok+=

Take a look at it, and tell me what you think.

Regards,

John R. Bandela

--- In boost_at_y..., "Gennadiy E. Rozental" <rogeeff_at_m...> wrote:
> Hi, John 
> 
> There was a discussion 
> http://groups.yahoo.com/group/boost/message/17306 to make a changes 
> in the Tokenizer. Did you have a chance to look in this directions. 
I 
> am still looking for assign-based version. 
> 
> Thank you 
> 
> Gennadiy.