Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Thousands of Spambot IPs Hitting my Site
lucy24 - 10:54 pm on Dec 16, 2011 (gmt 0)Thread source:: http://www.webmasterworld.com/search_engine_spiders/4396669.htm
It's much more likely to be a tiny little typo involving punctuation. Apache is very, very unforgiving.
But 5000? You're blocking too narrowly. Lock out whole ranges. Heck, lock out whole countries if you feel like it.
Brought to you by WebmasterWorld: http://www.webmasterworld.com