Page is a not externally linkable
- WebmasterWorld
-- Webmaster General
---- bandwidth Issue

incrediBILL - 9:22 pm on May 23, 2011 (gmt 0)


Whitelist your robots.txt and .htaccess file, then install a script to stop scrapers that speed through collecting pages, you can find one in our PHP forum and several on the web.

Food for thought, long since posted:
[webmasterworld.com...]
[webmasterworld.com...]
[webmasterworld.com...]

Thread source:: http://www.webmasterworld.com/webmaster/4315608.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com