Page is a not externally linkable
-- Webmaster General
---- bandwidth Issue
tangor - 11:08 am on May 21, 2011 (gmt 0)Thread source:: http://www.webmasterworld.com/webmaster/4315608.htm
Whitelist in robots.txt first (ie. allow only what you want) then .htaccess all who disobey... much shorter list of do nots...
Brought to you by WebmasterWorld: http://www.webmasterworld.com