Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
fiestagirl - 4:44 pm on Apr 25, 2008 (gmt 0)Thread source:: http://www.webmasterworld.com/search_engine_spiders/3634758.htm
Yep, I've had thousands of requests from this thing in the last couple of weeks. And I'm not going to take it anymore. Not until I hear a REALLY good reason to take all that abuse.
Brought to you by WebmasterWorld: http://www.webmasterworld.com