boost tokenizer

From: pjgrenyer_at_[hidden]
Date: 2001-11-23 10:21:56

Dear All

I'm using the boost tokenizer to tokenise lines similar to this one:

first_initial		|23|1|

This gives me:

first
initial
23
1

but what I actually want is:

first_initial
23
1

Does anyone know how to get it to ignore the underscore?

Thanks
Paul