- Search Engines
-- Search Engine Spider and User Agent Identification
- 11:16 am on Dec 26, 2012
I'm not counting the msnbot-media requests for a day again
Slow activity from visitors in the past twelve hours.
Sixty-eight (68) requests for robots.txt from the msnbot-media/1.1 in a ten-hour period, and on one site.
My sites did not allow crawling of images for more than a decade and it appears MSN/Bing believes I'm going to change my methods every 10-15 minutes.
Brought to you by