Welcome to WebmasterWorld Guest from 126.96.36.199
Forum Moderators: mack
joined:Jan 20, 2003
Personally, bandwith is cheap for me and I'm willing to feed MSNbot as long as it doesn't impact performance for users.
So how much bandwith are you allowing?
While the folks with lots of low traffic pages, like forums, won't like the aggressive crawling, I sure love it. A complete database is an absolute necessity for MSN to compete with Google, so I hope we will see this sort of aggressive free crawling forever.
I just put up a three page website 4 days ago and have had 14 msnbot page requests in that time.
since there is no way I'm going to reprogram all my stuff to do proper last modified headers, way too much work for zero payoff on my end, is this something that can be fixed on msn's end?
I definitely welcome the aggressive crawl, although if msn is able to crush google we'll be singing a different song soon enough....
If MSN's search DOES end up crushing Google I'll be glad I was indexed. And even if it doesn't, there will certainly be enough hype about it in the beginning that it will be worth while.
SEO's are going to have a field day making sites index high in both Google AND MSN though.
It would be a good thing if Microsoft would work with webmasters if it wants to make a superior search engine. However most search engines are inherently algorithmic so that claim does not impress people here. :) (Though I still think that the emphasis on personalisation is wrong. The more important thing for most people I talk to about searching is the localisation aspect and the way Google et al are going about it is wrong - people do not search by postcodes.)
Until then I consider your intervention PR and damage control and that's not what I require or expect from you.
I don't apologize for being rude because I had to pay for the privilege of feeding your experiments last month.
Until then I consider your intervention PR and damage control
that's what I consider all these search engine guys who post here, why would you consider it anything else? I'm going to have to go to the store to buy more salt since you have to take everything the employee of a company says about said company's product with large grains of salt, I think I'll go with rock salt this time.
Especially MS, who don't have a very good track record in the PR area. But I still welcome a new search engine, I'd rather deal with 3 fairly equal ones than 1 main one, which is what I have to do now, google is getting boring with their endless tweaks [ hint: msn, make a reliable, stable product, with reliable, stable results, don't do huge algo tweaks if at all possible... nobody cares about search, they just care about getting reasonably decent results ].