[boost] Re: [tokenizer and token_iterator]requestforpolicyorredesign

From: Gennadiy Rozental (gennadiy.rozental_at_[hidden])
Date: 2004-09-28 16:35:33

> | Token iterator construction based on two iterators IMO is useful only
for
> | istream tokenization. I do provide this interface but as stand alone
class.
>
> I think I disagree. Consider the match of some regular expression applied
to
> a each line in a file. If you then want to tokenize each macth, then you
don't
> want
> copy strings around but work on a view.
>
> br
>
> Thorsten

Yeah. You right. I should've said "mostly useful". There some (comparatively
rare) case when you want to utilize iterator interface. But it does not
change my point: it still does not justify polluting main line interface.

Gennadiy.