Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- ScooperBot

Pfui - 2:46 pm on Sep 1, 2011 (gmt 0)


Same server farm, same double-tap feint:

server34.customscoop.com
ScooperBot www.customscoop.com

09/01 0n:59:57 /robots.txt
09/01 0n:59:58 /302
09/01 0n:59:59 /robots.txt

FWIW

Thread source:: http://www.webmasterworld.com/search_engine_spiders/4355054.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com