Welcome to WebmasterWorld Guest from 54.163.159.27

Forum Moderators: mack

Message Too Old, No Replies

msnbot

whats the use?

     
7:24 am on Mar 18, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:July 11, 2003
posts:955
votes: 0


Why does msnbot re-index thousands of web pages a day, when the results go nowhere? whats the use? I mean, if it was launching in May or June (2004), it would be a logical thing, but lets face it, rumors say its gonna launch in 2005 or even 2006, then why is it wasting so much of our bandwidth now?

What I have done is currently banned the spider via robots.txt. However, I will remove the ban once the real MSN search launches - in a year or two.

Life's too short to waste MB's of bandwidth for no reason :)

Sid
[note: by re-indexing, I did not mean indexing. Its logical for it index data slowly and to re-index it once in a while (once a month?) but totally wrong for it to re-index it in every day or two.]

8:15 am on Mar 18, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member sem4u is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Dec 18, 2002
posts:3067
votes: 1


Maybe there is a lot of testing going on behind the scenes? Maybe they are testing out how to make a fresher index than Google? Maybe they will launch sooner than you think?
8:32 am on Mar 18, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:July 11, 2003
posts:955
votes: 0


yeah, maybe

Sid

8:35 am on Mar 18, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member sem4u is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:Dec 18, 2002
posts:3067
votes: 1


No-one knows Sid - we just have to wait and see :)
6:45 am on Mar 27, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Feb 20, 2002
posts:812
votes: 1


Why bother banning the bot?

Surely it can't be taking all that much bandwidth?

8:14 am on Mar 27, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:July 11, 2003
posts:955
votes: 0


yes, it does not take much bandwidth in a day, but the thing is, it comes everyday to my site, downloads the whole site and leaves. Think long-term. How much bandwidth will it waste, everyday, until it launches in what? 1 year? 2 years?

Waste of bandwidth is much more valued than waste of time. ;)

Sid

11:00 am on Mar 27, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:Oct 25, 2001
posts:660
votes: 0


Sid - I'm with you.

MS = sizzle.

I'm waiting for the steak. Your site is huge Sid - block 'em. See if they actually respect robots.txt

I reckon if its not in msword format - thye'll ignore it anyway!

:)

11:22 am on Mar 27, 2004 (gmt 0)

New User

10+ Year Member

joined:Mar 20, 2004
posts:19
votes: 0


MSN search may become THE most used search engine in the future. I wouldn't ban msnbot. At some time it will stop reindexing your site everyday.
11:55 am on Mar 27, 2004 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member

joined:July 11, 2003
posts:955
votes: 0


MSN search may become THE most used search engine in the future. I wouldn't ban msnbot. At some time it will stop reindexing your site everyday.

In my original most, I said:
However, I will remove the ban once the real MSN search launches - in a year or two.

I reckon if its not in msword format - thye'll ignore it anyway!

lol, if they don't obey no robots.txt, I'm gonna ban them through .htaccess or IP - thats for sure.

I also see that WebmasterWorld has blocked msnbot, I guess Brett's been witnessing the same situation I am.

Sid