Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- MSN's many cloaked bots. Again.
dstiles - 9:28 pm on Aug 18, 2010 (gmt 0)Thread source:: http://www.webmasterworld.com/search_engine_spiders/4182830.htm
Basically, if it ain't a known bot UA it's dumped, even if it has a bot IP.
Apropos which, I read somewhere that msnbot is being changed to bingbot soon, wrapped up in a basic mozilla UA. So, no more quick and dirty ^msnbot tests. :(
Brought to you by WebmasterWorld: http://www.webmasterworld.com