homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Pubcon Platinum Sponsor 2014
Home / Forums Index / Google / Google News Archive
Forum Library, Charter, Moderator: open

Google News Archive Forum

Are new indexed pages being added to index?
Now that there is no sign of a "defined update" - New Google !

10+ Year Member

Msg#: 15776 posted 8:32 am on Aug 3, 2003 (gmt 0)

About 90 pages of our 500 page site are aurrently in Google's index for a while now. Are newer pages (which are received Googlebot visits) being added to the index in this present state of Google, or will we have to wait for a traditional "update"?



WebmasterWorld Senior Member marcia us a WebmasterWorld Top Contributor of All Time 10+ Year Member

Msg#: 15776 posted 7:01 am on Aug 4, 2003 (gmt 0)

Pages are being added to the index constantly. It's on a continuous basis, but there's no way to tell when or how long it will be.


10+ Year Member

Msg#: 15776 posted 8:21 am on Aug 4, 2003 (gmt 0)

I think "constantly" is a bit missleading. Google does not add pages each and every day to the live database.

Just as they used to update the included pages "regualarly" they are still "regular" just the frequency of inclusion has increased.


10+ Year Member

Msg#: 15776 posted 10:22 am on Aug 4, 2003 (gmt 0)

I'm with Marcia on the description. Google does add pages each and every day to its index, and has done so for ages.

The daily adds were usually a product of what was known as freshbot. Pages got loaded for a day or so and then appeared to drop out, and didn't really stick in the index until the deepbot had appeared and the dance happened.

GG stated way back to expect freshbot to start behaving like deepbot and I think that's happening now. People are referring to the new bot as freshdeepbot, but I'm sure that moniker will disappear once we're used to the new activity.

There are numerous posts here saying that such and such a site appeared within 2 or 3 days of publishing, and these pages have stuck around, so in otherwords freshbot is acting like the old deepbot and updating their index constantly.


WebmasterWorld Senior Member 10+ Year Member

Msg#: 15776 posted 10:28 am on Aug 4, 2003 (gmt 0)

I've just created a new site and moved it twice to it's final domain. After each move I updated the links of my established site to point to iz. Each time googlebot came calling within the hour.

The first site took around 3 days, thesecond one around 7 and the third and final domain around 7 days too, they were put up with a 3 day interval.



10+ Year Member

Msg#: 15776 posted 8:38 pm on Aug 4, 2003 (gmt 0)

i still disagree it did NOT add pages each and every day - i.e. 31 days out of 31 or 30 out of 30! During updates that wasn't the case as it wasn't the case prior to them Freshbot data went in and came out again before the update.

And now in this supposed new era data is NOT added i.e. visible everyday. I've gone through shed loads of results!

See [webmasterworld.com...]


10+ Year Member

Msg#: 15776 posted 2:46 am on Aug 5, 2003 (gmt 0)

Our site was recently down for a day whilst moving servers with pages redirected to a note saying "Under maintenance". Google spidered us that day, and after about a week our number of indexed pages went from 13,000 to 112, with the main result being "Under maintenance". For some reason not all our pages were removed; maybe we came back up before Google had finished spidering that one page... But whatever, since then I've checked the number of pages listed from our site every day, and it has most definitely been going up by roughly 50 a day. googlebot's been pretty busy so I'm hoping for a big jump at some point - fingers crossed.

Have to say though, if I was a web robot with 4 billion pages to check, seeing a site go from 13k+ pages to 1 would probably make me suspicious. My guess is that we were downgraded as a site somehow and are just going to have to sit and wait until Google's AI starts to trust us again.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Google / Google News Archive
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved