Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Thousands of Spambot IPs Hitting my Site


lucy24 - 11:05 am on Dec 14, 2011 (gmt 0)


The bot I had, I discovered it would action a 301 redirection, so redirected it to its own IP, which reduced the server load to practically zero.

Ooh, must try that. Generally I just send 'em to 127.0.0.1 if they put me in a bad mood.

Quick look at htaccess suggests that a lot of bots have been making me grumpy in recent months.


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4396669.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com