newbie question on tokenizer and unicode text

From: elqed1 (elqed1_at_[hidden])
Date: 2002-09-21 06:19:21

Hi all,

I'm a newcomer to boost and am rewriting one of my text 
characterization programs to use some boost libraries. I'm running 
into a problem with non ascii text.

I'm using MSVC 7.0 to compile my program and the project is setup to 
link to the unicode CRT.

The problem is when boost::char_delimiters_separator<>::is_nonret is 
calling MSVC's CRT std::isspace() which takes an int; and isspace() 
is (of course) choking on a '©' (for example) in my training data. 

Is there something obvious I'm missing?

Thanks in advance.

-Eric Lucas