Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- msnbot-media


lucy24 - 8:10 pm on Feb 11, 2013 (gmt 0)


Bingbot also sometimes injects a nonexistent directory into valid file paths rendering them non-valid

Isn't this one of the things search engines do on purpose to make sure you haven't got any lurking Soft 404s? 200 out of 500 does seem a bit over the top, though.


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4470273.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com