Has anybody managed to get tokenizer working for wide characters with VC7.1 (boost version 1.31.0)?  The following example works fine...
 
typedef tokenizer<char_separator<std::string::value_type>,
 std::string::const_iterator, std::string> MyTokenizer;
 
const char_separator<std::string::value_type> sep("a");
 
MyTokenizer token(std::string("abacadaeafag"), sep);
for (MyTokenizer::const_iterator it = token.begin(); it != token.end(); ++it)
{
    std::cout << *it;
}
...while the following example produces no output...
 
typedef tokenizer<char_separator<std::wstring::value_type>,
 std::wstring::const_iterator, std::wstring> MyTokenizer;
 
const char_separator<std::wstring::value_type> sep(L"a");
 
MyTokenizer token(std::wstring(L"abacadaeafag"), sep);
for (MyTokenizer::const_iterator it = token.begin(); it != token.end(); ++it)
{
    std::wcout << *it;
}
Cheers,
 
Douglas.