Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
fusion5 - 8:15 pm on Jun 2, 2006 (gmt 0)Thread source:: http://www.webmasterworld.com/search_engine_spiders/3269.htm
I orig. posted a similar msg. at abt. this, too.
Guess we got hit at pretty much the same time.
I had it coming from 22.214.171.124. It hit robots.txt, then went through all the main pages.
Brought to you by WebmasterWorld: http://www.webmasterworld.com