[Boost-users] tokenizer and wstring with VC7.1

From: Douglas G. Hanley (DHanley_at_[hidden])
Date: 2004-02-20 09:40:29

Has anybody managed to get tokenizer working for wide characters with
VC7.1 (boost version 1.31.0)?  The following example works fine...
 
typedef tokenizer<char_separator<std::string::value_type>,
 std::string::const_iterator, std::string> MyTokenizer;
 
const char_separator<std::string::value_type> sep("a");
 
MyTokenizer token(std::string("abacadaeafag"), sep);
for (MyTokenizer::const_iterator it = token.begin(); it != token.end();
++it)
{
    std::cout << *it;
}

...while the following example produces no output...
 
typedef tokenizer<char_separator<std::wstring::value_type>,
 std::wstring::const_iterator, std::wstring> MyTokenizer;
 
const char_separator<std::wstring::value_type> sep(L"a");
 
MyTokenizer token(std::wstring(L"abacadaeafag"), sep);
for (MyTokenizer::const_iterator it = token.begin(); it != token.end();
++it)
{
    std::wcout << *it;
}

Cheers,
 
Douglas.