[boost] [Tokenizer] A hybrid between char_separator and escaped_list_separator

From: Zvi Tarem (zvi.tarem_at_[hidden])
Date: 2005-12-07 03:17:25

It would be very useful to have a tokenizer that operates similar to the 
regular char_separator, but also handles delimiters in quoted portions like 
escaped_list_separator. For example:

Input:    model  name = "My Model"  label="A short label = A good label" 
parts= 3
Output:   <model> <name> <=> <My Model> <label> <=> <A short label = A good 
label> <parts> <=> <3>

Regards,

Zvi Tarem (zvi.tarem_at_[hidden])