[boost] Re: [tokenizer and token_iterator] requestforpolicyorredesign

From: Thorsten Ottosen (nesotto_at_[hidden])
Date: 2004-09-28 16:20:38

"Gennadiy Rozental" <gennadiy.rozental_at_[hidden]> wrote in message
news:cjcit7$dpe$1_at_sea.gmane.org...

| Token iterator construction based on two iterators IMO is useful only for
| istream tokenization. I do provide this interface but as stand alone class.

I think I disagree. Consider the match of some regular expression applied to
a each line in a file. If you then want to tokenize each macth, then you don't
want
copy strings around but work on a view.

br

Thorsten