Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- Fake Googlebot from StandardShell


Samizdata - 4:18 pm on Nov 12, 2008 (gmt 0)


Don't get me wrong, I sympathise entirely. I too would prefer consistency.

The problem seems to lie with various Mountain View robots using IP ranges that are also proxies used by the Wireless Transcoder and Translator. But none are named "Googlebot".

...


Thread source:: http://www.webmasterworld.com/search_engine_spiders/3783041.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com