[Boost-commit] svn:boost r56085 - trunk/boost/spirit/home/lex

Subject: [Boost-commit] svn:boost r56085 - trunk/boost/spirit/home/lex
From: hartmut.kaiser_at_[hidden]
Date: 2009-09-07 09:52:30

Author: hkaiser
Date: 2009-09-07 09:52:28 EDT (Mon, 07 Sep 2009)
New Revision: 56085
URL: http://svn.boost.org/trac/boost/changeset/56085

Log:
Spirit: Unified semantics of tokenize_and_parse functions
Text files modified: 
   trunk/boost/spirit/home/lex/tokenize_and_parse.hpp |     2 +-                                      
   1 files changed, 1 insertions(+), 1 deletions(-)

Modified: trunk/boost/spirit/home/lex/tokenize_and_parse.hpp
==============================================================================
--- trunk/boost/spirit/home/lex/tokenize_and_parse.hpp	(original)
+++ trunk/boost/spirit/home/lex/tokenize_and_parse.hpp	2009-09-07 09:52:28 EDT (Mon, 07 Sep 2009)
@@ -291,7 +291,7 @@
 
         iterator_type iter = lex.begin(first, last, initial_state);
         iterator_type end = lex.end();
-        for (/**/; iter != end; ++iter) 
+        for (/**/; iter != end && token_is_valid(*iter); ++iter) 
         {
             if (!detail::tokenize_callback(*iter, f))
                 return false;