Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
idiotgirl - 6:48 pm on Jul 6, 2008 (gmt 0)Thread source:: http://www.webmasterworld.com/search_engine_spiders/3686831.htm
As far as I can see there is no stopping this bot. It doesn't respect robots.txt and comes slinking through like a hungry dog every time you turn around. It will gladly eat 403's for eternity until you firewall them out.
Brought to you by WebmasterWorld: http://www.webmasterworld.com