Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- MSNBot has become a constant Fast-Scraper

bingdude - 8:42 pm on Dec 28, 2011 (gmt 0)


AlexK,

Have you used the Bing Webmaster Tools specifically designed to allow you to control the rate at which we crawl your website?

You can spec a lower rate whenever you choose through the custom tool.

Thread source:: http://www.webmasterworld.com/search_engine_spiders/4401159.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com