Page is a not externally linkable
- Search Engines
-- Search Engine Spider and User Agent Identification
---- msnbot-media


wilderness - 11:16 am on Dec 26, 2012 (gmt 0)


I'm not counting the msnbot-media requests for a day again


Slow activity from visitors in the past twelve hours.

Sixty-eight (68) requests for robots.txt from the msnbot-media/1.1 in a ten-hour period, and on one site.

My sites did not allow crawling of images for more than a decade and it appears MSN/Bing believes I'm going to change my methods every 10-15 minutes.


Thread source:: http://www.webmasterworld.com/search_engine_spiders/4470273.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com