Welcome to WebmasterWorld Guest from

Forum Moderators: mack

Message Too Old, No Replies


does not download much

1:10 pm on Dec 5, 2008 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Mar 12, 2002
posts: 1144
votes: 0

With respect to Yahoo Slurp and GoogleBot - how much does not MSNBot
download for you?

I got MSNBot downloading less than 5% of what the other 2 bots are downloading.

2:48 am on Dec 6, 2008 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Dec 9, 2001
votes: 0

Two or three years ago the msn bot was crawling like crazy -- in fact, it was using up so much bandwidth that many of us were wondering how to slow it down (the main suggestion being "Crawl-delay:", which I tried but then abandoned).

At some time thereafter, for whatever reason, it went in exactly the opposite direction. Now I see the same thing that you see -- the other 2 major bots crawl dependably, and msn comes around occasionally and only hits a few pages.

I've said before and I continue to believe -- MSN/Live is #3 for a reason, and that reason is they just do not seem to be able to get it right. Which perhaps just goes to prove that a company that excels at desktop applications will not necessarily have as much impact in their web apps. And it may also explain why they wanted Yahoo...


9:20 am on Feb 18, 2009 (gmt 0)

New User

5+ Year Member

joined:Feb 18, 2009
votes: 0

This might explain the troubles I'm having with Live Search at this point.

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members