homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Microsoft / Bing Search Engine News
Forum Library, Charter, Moderators: mack

Bing Search Engine News Forum

Microsoft Updates Crawler - Supports Compression and If-Modified-Since

 10:49 pm on Feb 12, 2008 (gmt 0)

SearchEngineWorld [searchengineworld.com]

Microsoft Live Search has changed the way its Web crawler application operates when indexing millions of Web sites for inclusion in its search engine, adding features aimed at increasing the efficiency of the process by using compression and other techniques to lower the amount of work required by Web servers, the company announced today



 1:53 am on Feb 13, 2008 (gmt 0)

At last they are catching up with some basic functionality! Google and Yahoo have been supporting this for years. It's a rather sad testament to Microsoft's progress that they have taken this long to get to their crawler up to standard.


 2:43 am on Feb 13, 2008 (gmt 0)

welcome to WebmasterWorld [webmasterworld.com], zekele!


 3:08 am on Feb 13, 2008 (gmt 0)

> At last they are catching up

Indeed! I rather like the audacious ending to the article:

Microsoft urges webmasters to make sure their servers are ready to take advantage of the Live Search features added today.

Bill, I don't need urging, I read RFC2616 years ago. Nice to see you're keeping yourself busy, though.

About that article... who is the intended audience? It seems to be for either webmasters or idiots. Given the fact the author failed to explain what a "blog" is - and I'm therefore at a loss - I'd have to assume I'm a webmaster. ;)

I'll second the motion - Welcome to WebmasterWorld, zekele!


 9:04 am on Feb 13, 2008 (gmt 0)

Now if we could just get them to stop the //search.live.com/results.aspx?q=BIG-KEYWORD&mrt=en-us&FORM=LIVSOP Junk that doubles the amount of traffic from the bot in question - that would really SWELL!

ref: [webmasterworld.com...]

Global Options:
 top home search open messages active posts  

Home / Forums Index / Microsoft / Bing Search Engine News
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved