homepage Welcome to WebmasterWorld Guest from 54.205.106.111
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Microsoft / Bing Search Engine News
Forum Library, Charter, Moderators: mack

Bing Search Engine News Forum

    
Number of indexed pages changes all the time
site:www.domain.com fluctuate widely from day to day
sasha




msg:1535617
 10:27 pm on Mar 22, 2005 (gmt 0)

This has been our situation = MSN had been hitting the site aggressively prior to their search engine launch. When the launch happened the site had about 8,000 URLs in the index. While this seems like a lot - they actually spidered a lot more URLs than that (our site has 50,000 URLs). From then on the number of indexed pages changes quite frequently both UP and DOWN constantly. Looks like MSN does not have any 'memory' of the URLs it spiders and must re-spider pages constantly to have a representation of a site in its index.

 

Sanenet




msg:1535618
 10:54 pm on Mar 22, 2005 (gmt 0)

That could be a good idea for a rapidly changing web, everytime you respider drop all previously cached pages, on a site by site basis rather than a database by database. I've seen some evidence of this on some sites I used to monitor, everytime MSN respidered by old pages were vanishing from the index. (Superficial testing only I hasten to add).

Stops all the clutter of old, orphaned, dead or vanished pages oi suppose!

Global Options:
 top home search open messages active posts  
 

Home / Forums Index / Microsoft / Bing Search Engine News
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved