Page is a not externally linkable
- Microsoft
-- Bing Search Engine News
---- New, Faster, Improved Image Search On Bing


not2easy - 8:54 pm on Dec 29, 2012 (gmt 0)


The only way I can think of is to block the Bing Preview UA, I would be happier to find out there is another way. A noindex in the header would be signaling to gugle and bing not to index your page, I don't want that to happen. I am disallowing .jpg, .png and .gif as well as the msnbot in robots.txt, but it is not robots.txt compliant so that can't help much.
If their bots used different IP ranges it would be easy but they must have dozens of UA strings. I'm seeing the msnbot grabbing useless insignificant images like an old menu divider gif and css files, they seem to love css files. I sometimes think they are scraping css files to see if they can figure out how to make IE fully compliant, :).


Thread source:: http://www.webmasterworld.com/msn_microsoft_search/4529395.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com