Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Thousands of Spambot IPs Hitting my Site


tangor - 12:06 am on Dec 12, 2011 (gmt 0)


tangor,
Think your biting off more than your able to chew here.
Please see his initial thread in the Apache forum.


Dumping AmazonAWS into .htaccess has one line... little chewing involved. :)

Pick and choose battles, of course, but if one is facing real money costs in exceeding bandwidth, one responds as necessary.


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4396669.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com