Msg#: 3800785 posted 2:48 am on Dec 6, 2008 (gmt 0)
Two or three years ago the msn bot was crawling like crazy -- in fact, it was using up so much bandwidth that many of us were wondering how to slow it down (the main suggestion being "Crawl-delay:", which I tried but then abandoned).
At some time thereafter, for whatever reason, it went in exactly the opposite direction. Now I see the same thing that you see -- the other 2 major bots crawl dependably, and msn comes around occasionally and only hits a few pages.
I've said before and I continue to believe -- MSN/Live is #3 for a reason, and that reason is they just do not seem to be able to get it right. Which perhaps just goes to prove that a company that excels at desktop applications will not necessarily have as much impact in their web apps. And it may also explain why they wanted Yahoo...