Welcome to WebmasterWorld Guest from

Forum Moderators: mack

Message Too Old, No Replies


does not download much

1:10 pm on Dec 5, 2008 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Mar 12, 2002
posts: 1144
votes: 0

With respect to Yahoo Slurp and GoogleBot - how much does not MSNBot
download for you?

I got MSNBot downloading less than 5% of what the other 2 bots are downloading.

2:48 am on Dec 6, 2008 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Dec 9, 2001
votes: 0

Two or three years ago the msn bot was crawling like crazy -- in fact, it was using up so much bandwidth that many of us were wondering how to slow it down (the main suggestion being "Crawl-delay:", which I tried but then abandoned).

At some time thereafter, for whatever reason, it went in exactly the opposite direction. Now I see the same thing that you see -- the other 2 major bots crawl dependably, and msn comes around occasionally and only hits a few pages.

I've said before and I continue to believe -- MSN/Live is #3 for a reason, and that reason is they just do not seem to be able to get it right. Which perhaps just goes to prove that a company that excels at desktop applications will not necessarily have as much impact in their web apps. And it may also explain why they wanted Yahoo...


9:20 am on Feb 18, 2009 (gmt 0)

New User

5+ Year Member

joined:Feb 18, 2009
votes: 0

This might explain the troubles I'm having with Live Search at this point.