Welcome to WebmasterWorld Guest from 18.104.22.168
Forum Moderators: mack
What I have done is currently banned the spider via robots.txt. However, I will remove the ban once the real MSN search launches - in a year or two.
Life's too short to waste MB's of bandwidth for no reason :)
[note: by re-indexing, I did not mean indexing. Its logical for it index data slowly and to re-index it once in a while (once a month?) but totally wrong for it to re-index it in every day or two.]
Waste of bandwidth is much more valued than waste of time. ;)
MSN search may become THE most used search engine in the future. I wouldn't ban msnbot. At some time it will stop reindexing your site everyday.
In my original most, I said:
However, I will remove the ban once the real MSN search launches - in a year or two.
I reckon if its not in msword format - thye'll ignore it anyway!
lol, if they don't obey no robots.txt, I'm gonna ban them through .htaccess or IP - thats for sure.
I also see that WebmasterWorld has blocked msnbot, I guess Brett's been witnessing the same situation I am.