Welcome to WebmasterWorld Guest from 23.20.75.214

Forum Moderators: mack

Message Too Old, No Replies

Microsoft Updates Crawler - Supports Compression and If-Modified-Since

     
10:49 pm on Feb 12, 2008 (gmt 0)

Administrator from US 

WebmasterWorld Administrator brett_tabke is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Sept 21, 1999
posts:38061
votes: 13


SearchEngineWorld [searchengineworld.com]

Microsoft Live Search has changed the way its Web crawler application operates when indexing millions of Web sites for inclusion in its search engine, adding features aimed at increasing the efficiency of the process by using compression and other techniques to lower the amount of work required by Web servers, the company announced today
1:53 am on Feb 13, 2008 (gmt 0)

New User

5+ Year Member

joined:Jan 2, 2008
posts:2
votes: 0


At last they are catching up with some basic functionality! Google and Yahoo have been supporting this for years. It's a rather sad testament to Microsoft's progress that they have taken this long to get to their crawler up to standard.
2:43 am on Feb 13, 2008 (gmt 0)

Administrator

WebmasterWorld Administrator phranque is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Aug 10, 2004
posts:10553
votes: 13


welcome to WebmasterWorld [webmasterworld.com], zekele!
3:08 am on Feb 13, 2008 (gmt 0)

Preferred Member

10+ Year Member

joined:May 27, 2003
posts:503
votes: 0


> At last they are catching up

Indeed! I rather like the audacious ending to the article:

Microsoft urges webmasters to make sure their servers are ready to take advantage of the Live Search features added today.

Bill, I don't need urging, I read RFC2616 years ago. Nice to see you're keeping yourself busy, though.

About that article... who is the intended audience? It seems to be for either webmasters or idiots. Given the fact the author failed to explain what a "blog" is - and I'm therefore at a loss - I'd have to assume I'm a webmaster. ;)


I'll second the motion - Welcome to WebmasterWorld, zekele!

9:04 am on Feb 13, 2008 (gmt 0)

Senior Member

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month

joined:Dec 27, 2004
posts:1833
votes: 47


Now if we could just get them to stop the //search.live.com/results.aspx?q=BIG-KEYWORD&mrt=en-us&FORM=LIVSOP Junk that doubles the amount of traffic from the bot in question - that would really SWELL!

ref: [webmasterworld.com...]