Re: [Boost-users] Tokenizer Question

From: Tom Browder (tbrowder_at_[hidden])
Date: 2005-06-19 09:53:30

> -----Original Message-----
> From: boost-users-bounces_at_[hidden] 
> [mailto:boost-users-bounces_at_[hidden]] On Behalf Of Robert Zeh
> Sent: Friday, June 17, 2005 10:00 PM
> To: boost-users_at_[hidden]
> Tom, thank you for the test package.  It is very well put 
> together, and I was able to start using it out of the box.

You're welcome.  Glad it worked.

> I tried things on my box.  Without compiler optimization 
> enabled (-O3) and no profiling I get the following timings: 
> (running each executable with -i):

Iterating over the token container after it is instantiated:
 
> ttb: (boost)
> 28.93 user .38 system
> tts (Tom Browder's)
> 24.25 user 0.92 system
> ttv (Victor Wagner's)
> 24.66 user 1.05 system 
 
> With compiler optimization I get much better results:
> razeh_at_squirmy:~/timing/tokenizer_test$ make time
> ttb: (boost)
> 16.49 user 0.33 system
> tts: (Tom Browder's)
> 21.46 user 0.95 system
> ttv: (Victor Wagner's)
> 21.91 user 1.00 system

I'll bet if the boost::tokenizer developer made a special white space
tokenizer it would better yet:  the reason for my post to this list in the
first place.

-Tom Browder