Welcome to WebmasterWorld Guest from 54.167.71.219

Forum Moderators: mack

Message Too Old, No Replies

MSN Bot

does not download much

     
1:10 pm on Dec 5, 2008 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Mar 12, 2002
posts: 1123
votes: 0


With respect to Yahoo Slurp and GoogleBot - how much does not MSNBot
download for you?

I got MSNBot downloading less than 5% of what the other 2 bots are downloading.

2:48 am on Dec 6, 2008 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Dec 9, 2001
posts:1307
votes: 0


Two or three years ago the msn bot was crawling like crazy -- in fact, it was using up so much bandwidth that many of us were wondering how to slow it down (the main suggestion being "Crawl-delay:", which I tried but then abandoned).

At some time thereafter, for whatever reason, it went in exactly the opposite direction. Now I see the same thing that you see -- the other 2 major bots crawl dependably, and msn comes around occasionally and only hits a few pages.

I've said before and I continue to believe -- MSN/Live is #3 for a reason, and that reason is they just do not seem to be able to get it right. Which perhaps just goes to prove that a company that excels at desktop applications will not necessarily have as much impact in their web apps. And it may also explain why they wanted Yahoo...

**********************************

9:20 am on Feb 18, 2009 (gmt 0)

New User

5+ Year Member

joined:Feb 18, 2009
posts:4
votes: 0


This might explain the troubles I'm having with Live Search at this point.