not2easy - 7:45 pm on Dec 30, 2013 (gmt 0)
Welcome to WebmasterWorld Forum, MJBill, you can get some insight looking around.
The msnbot and msn-media bots periodically take acid. OK, maybe they don't but they do act like it. I have blocked their ranges because they do not always follow directives in robots.txt - although heaven knows they have ample opportunities, grabbing that file every few seconds. They don't seem to "get" what 404 means and "403" after a few thousand more files may slow them somewhat. Good luck.