Tokenizer and empty tokens

From: johan.nilsson_at_[hidden]
Date: 2001-08-23 02:57:13

[first of all, sorry if this results in a repost from yesterday]

Hi,

is it possible to use the tokenizer to get (embedded) empty tokens 
extracted? I tried to search the archives on this; couldn't find 
anything.

E.g.:

---
string str("one,two,,four");
tokenizer<> tok(str);
copy(tok.begin(), tok.end(), ostream_iterator<string>(cout, "\n"));
---
Would render something like the following:
---
one
two
four
---
// Johan