Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- very unusual swarm of crawlers


wilderness - 12:28 am on Feb 27, 2012 (gmt 0)


many thanks DeeCee.

They all requested the same partial and incomplete page name.

All were denied because this directory is highly browser restricted and is used for temp pages and to fulfill immediate needs.

All the IP's were previously denied in my main site, with the exception of one, and it was enjoyable to become aware of a colo I wasn't previously aware of ;)


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4421994.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com