Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- MSN bot hitting hard without a referrer
g1smd - 9:29 pm on Aug 30, 2011 (gmt 0)Thread source:: http://www.webmasterworld.com/search_engine_spiders/4356257.htm
I see a variety of accesses from agents that claim to be Googlebot, but which come from various non-Google IP addresses. It's not so easy to identify this for Bing, because they don't publish a list of valid IP addresses.
Brought to you by WebmasterWorld: http://www.webmasterworld.com