Boost logo

Boost :

Subject: Re: [boost] [locale] [filesystem] Windows local 8 bit encoding
From: Jookia (166291_at_[hidden])
Date: 2012-11-30 05:35:36


On 30/11/12 21:29, Ryo IGARASHI wrote:
> If you have a CP932-encoded string, convert to UTF-8, and then
> convert back to CP932 string, the first and the third string may be *different*.
> This means that the original information is (somewhat) lost.
>
> This means that in order to handle the Japanese string properly under Windows,
> the programmers are encouraged not to convert at all.
>
> Moreover, at least 2 major (and slightly different) Shift_JIS <->
> UTF-8 mapping table exists.
> i.e. the same Shift_JIS text will map to different UTF-8 string.
> (2 which are provided by Unicode Consortium and Microsoft)

Sorry if this sounds silly, but what's the problem if we just stick to
one mapping table consistently?


Boost list run by bdawes at acm.org, gregod at cs.rpi.edu, cpdaniel at pacbell.net, john at johnmaddock.co.uk