[Boost-commit] svn:boost r77126 - website/public_html/live

Subject: [Boost-commit] svn:boost r77126 - website/public_html/live
From: dnljms_at_[hidden]
Date: 2012-02-27 11:35:40

Author: danieljames
Date: 2012-02-27 11:35:39 EST (Mon, 27 Feb 2012)
New Revision: 77126
URL: http://svn.boost.org/trac/boost/changeset/77126

Log:
Websites: Block bots from beta documentation.
Text files modified: 
   website/public_html/live/robots.txt |     1 +                                       
   1 files changed, 1 insertions(+), 0 deletions(-)

Modified: website/public_html/live/robots.txt
==============================================================================
--- website/public_html/live/robots.txt	(original)
+++ website/public_html/live/robots.txt	2012-02-27 11:35:39 EST (Mon, 27 Feb 2012)
@@ -1,4 +1,5 @@
 User-agent: *
 Disallow: /development          # Hide huge zip files
+Disallow: /doc/libs/1_49_0_beta1/
 Crawl-delay: 10
 Sitemap: http://www.boost.org/sitemap.xml.php