[Boost-build] Regex.split on a string of 13, 000 newline-delimited filepaths (700kB) is prohibitively memory-intensive

Subject: [Boost-build] Regex.split on a string of 13, 000 newline-delimited filepaths (700kB) is prohibitively memory-intensive
From: Matthew Chambers (matthew.chambers_at_[hidden])
Date: 2009-09-09 18:21:59

Attached is a simple test case based on the list of ".?[pp]" files in 
the boost source tarball, plus tools/build and tools/jam.

It seems like a token-centric split method is appropriate, or a much 
more efficient regex implementation.

Thanks,
Matt