Forum Moderators: open

Message Too Old, No Replies

Does Google remove pages from index every time it reshuffles?

         

irock

7:04 pm on Aug 27, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I currently have about 2500 pages inside Google index. I was wondering if Google will increase the amount of pages or remove them and start over again from zero.

Thanks!

Ian

Sathish

7:21 pm on Aug 27, 2002 (gmt 0)

10+ Year Member



The process is not like "google removes your pages and adds it again". Its like this "if your pages crawled before that months update your pages get indexed. If not crawled its not added to that months database.

So it depends on how many pages googlebot can crawl deep in to your site. Googlebot becomes your mate. Once when it hit your page it keeps coming back. Hopefully your no of pages indexed keep increasing everymonth as you increase your site database.

irock

8:08 pm on Aug 27, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



"Once when it hit your page it keeps coming back."

Oh... so Google will come back for my 2500 pages again for this month. Am I right?

JayC

8:19 pm on Aug 27, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Generally, you can expect that. But you can not count on it. There's no guarantee that every page will be listed in each subsequent index once it's gotten in -- usually, though, that's what happens; and in fact if not all of your pages are in, or you are adding more, you will normally see the number increase.

But you have to realize that sometimes it might not happen that way. Best way to assure it: continually grow your PageRank, and do whatever you can to make sure you site is always reachable.

Grumpus

8:47 pm on Aug 27, 2002 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



My pages change from month to month. I can be sure that certain pages are going to be in there (usually ones in the root directory make it, so long as there's a link from the front page), but beyond that, it's rather a lottery. Not even all of my 8 pages listed at the DMOZ are guaranteed a crawl - in fact, only 2 of the 8 are actually in Google's index this month, despite the fact that they are in Google's directory. Go figure.

Each month, googlebot erases everything it knows about your site and starts fresh. You can count on roughly the same amount of pages to be crawled next month (that'll increase as your PR does), but you can't really be certain which ones will make it and which won't. I've tried everything to "nudge" google toward indexing the pages that "I" would like to be in the index, but so far, I've had no luck at all. There are pages linked off my front page that don't get crawled while there are pages on my site that no one - not even me - besides the Googlebot has ever looked at. My situation is more extreme than most, though, as there are over a million pages that the bot could crawl.

G.