Re: [boost] RFC: interest in Unicode codecs?

Subject: Re: [boost] RFC: interest in Unicode codecs?
From: Mathias Gaunard (mathias.gaunard_at_[hidden])
Date: 2009-07-18 01:43:33

OvermindDL1 wrote:
> On Sat, Feb 14, 2009 at 10:07 AM, Phil Endecott
> <spam_from_boost_dev_at_[hidden]> wrote:
>> /* snip */
>> Yes, a Unicode character properties library is important to those who are
>> writing text editors and similar applications.  Perhaps Boost should have
>> one.  I have personally used the Unicode properties tables for doing
>> "approximate matching" of e.g. accented characters with their base
>> characters when searching.  But I can do that equally well in UTF-8 as in
>> UTF-32.
> 
> If you are all interested in other opinions, I would love for boost to
> have a UTF8(16/32) helper library.

There is a google summer of code project for a unicode library which I'm 
working on.

It allows handling of unicode text in any of UTF-8, UTF-16 or UTF-32 
encodings, bundles a small-ish unicode character database, supports 
grapheme boundaries, composition/decomposition and normalization, but 
not "approximate matching", collation or case folding (at least it won't 
for the time being).