[Boost-users] [boost-users] tokenizer vs string algorithm split.

From: chun ping wang (cablepuff_at_[hidden])
Date: 2007-12-12 22:56:58

Hi I was wondering which one is better and faster to split a file of csv
value of number and put it into container of double.
1.) Which option is better.
             // method 1.
             std::vector<std::string> split_string;
             boost::algorithm::trim(flist);
             boost::algorithm::split(split_string, flist,
boost::algorithm::is_any_of(","));
             std::vector<double> elements;
             BOOST_FOREACH(std::string s, split_string)
             {
                 elements += boost::lexical_cast<double>(s);
              }

              // method 2.
               boost::char_separator<char> sep(",");
               boost::tokenizer<boost::char_separator<char> > tokens(flist,
sep);
               std::vector<double> elements;
               BOOST_FOREACH(std::string token, tokens)
               {
                   elements += boost::lexical_cast<double>(token);
               }

2.) When is it better to use string algorithm split instead of tokenizer and
vice versa.