Tokenizer and empty tokens

From: johan.nilsson_at_[hidden]
Date: 2001-08-22 06:01:39

Hi,

is it possible to use the current tokenizer and get empty tokens 
extracted? I tried to search the archives on this; couldn't find 
anything.

E.g.:

//
// This code might not be correct, but you'll get the idea ...
//
string str("one,two,,four");
tokenizer<> tok(str);
copy(tok.begin(), tok.end(), ostream_iterator<string>(cout, "\n"));

---
Would render something like the following:
---
one
two
four
---
// Johan