Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- MSN's many cloaked bots. Again.


AlexK - 5:27 pm on Sep 2, 2010 (gmt 0)


dstiles:
from observation ... non-bot UAs from their bot lines. As do google

Cannot disagree more. Of all the bot IPs, G is as clean as a whistle, which is more than can be said of any others (and I am the opposite of a G-Fanboy). Sure, G employees try to hack from G netblocks but, I say again, the *bot* IP is as clean as a whistle and, in my experience, always has been.

keyplyr:
These types of hits have been coming ... for years

That makes it OK?


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4182830.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com