Re: [Boost-bugs] [Boost C++ Libraries] #12859: std::string_view as token

Subject: Re: [Boost-bugs] [Boost C++ Libraries] #12859: std::string_view as token
From: Boost C++ Libraries (noreply_at_[hidden])
Date: 2017-03-01 14:33:47

#12859: std::string_view as token
-------------------------------------------------+-------------------------
  Reporter:  Johel Ernesto Guerrero Peña         |      Owner:  jsiek
  <johelegp@…>                                   |     Status:  new
      Type:  Feature Requests                    |  Component:  tokenizer
 Milestone:  To Be Determined                    |   Severity:
   Version:  Boost 1.63.0                        |  Optimization
Resolution:                                      |   Keywords:  string_view
-------------------------------------------------+-------------------------

Comment (by Johel Ernesto Guerrero Peña <johelegp@…>):

 This is my particular use case:
 {{{
 auto tokenize(std::string_view to_tokenize, const char* separators)
 {
     using TokenizerFunction = boost::char_separator<char>;
     using Tokenizer         = boost::tokenizer<
         TokenizerFunction, std::string_view::iterator, std::string_view>;

     return Tokenizer{to_tokenize, TokenizerFunction{separators}};
 }
 }}}
 I want the Tokenizer to recognize that the token type is not constructible
 from two iterators, and try to construct it from a {pointer,size} pair
 instead.

-- 
Ticket URL: <https://svn.boost.org/trac/boost/ticket/12859#comment:2>
Boost C++ Libraries <http://www.boost.org/>
Boost provides free peer-reviewed portable C++ source libraries.