Re: [boost] UTF-8 conversion setc. [was: [String algorithm] is_any_of has inefficient implementation]

From: Phil Endecott (spam_from_boost_dev_at_[hidden])
Date: 2008-02-16 14:00:19

Felipe Magno de Almeida wrote:
> On Fri, Feb 15, 2008 at 3:54 PM, Phil Endecott
> <spam_from_boost_dev_at_[hidden]> wrote:
>>  This week I
>>  have been writing some UTF-8 encoding and decoding and
>>  Unicode<->iso8859 conversion algorithms.  They seem to be faster than
>>  the libc implementations which is satisfying especially as I haven't
>>  even started on the serious optimisations yet.  This will be part of
>>  the strings-tagged-with-character-sets stuff that I have described
>>  before.  Anyone interested?
>
> Sure. Though I'm most interested in all charset conversions. But the
> most usual is enough to speed up my application *a lot*.

Thanks to everyone who expressed an interest.

I will attempt to have some sort of documentation and code available in 
the next few days.  Pester me if I don't produce anything.

If you can describe your typical data, i.e. which character set pairs 
you're converting between, or even better send me some test data to 
benchmark with, that would give a target to work towards.

Cheers,  Phil.