Google Growth Index on hold

Maturity, little glitch or teen crisis? ;-)

[Allergic]

Here the data collect from WayBackMachine of the Google main page and somes holes fill from SEW and SESD :

11/1998 : 0,02G (25 millions)
09/1999 : 0,08G
± 300% growth
06/2000 : 0,56G
07/2000 : 1,06G
11/2000 : 1,24G
± 200% growth
01/2001 : 1,32G
11/2001 : 1,61G
12/2001 : 2,07G
± 175% growth
08/2002 : 2,46G
11/2002 : 3,03G
± 50% growth
01/2003 : 3,03G
07/2003 : 3,03G
0% growth

Sergey got only 5 month left to get is goal [detnews.com]!
Hope it will have it.

PS. The % of growth is not scientific at all and just for getting a idea.

[brotherhood of LAN]

They change that number manually, Googleguy even 'admitted' this a while back on the boards ;)

Search for 'the' and you'll fine a higher number of pages. They'll update that homepage eventually...

[Allergic]

I know about the number BoL, but the point I want to raise is the stagnation and/or even decrease.
Since nov. 2002, we sometime saw 3,75G of the "the" (specially in Google Dance before they apply filter) and now is back to 3,31G.

Even the other filetype [webmasterworld.com] (doc,pdf,etc) who don't (I think) have any filter have dramatically decrease!

[brotherhood of LAN]

They may not even cover one half of the web, I would not call it maturity, nor a glitch.

I read there are 10b docs on the web, yeah it mentions it on that news article too, so it cannot be maturity.

So what about the other 6/7 billion....not sure if Google have a choice about it either. Could they possibly index 10 billion pages a month? As well as keep the more important ones fresh in between.

Time, technology or poor quality pages are my 3 votes towards the answer......maybe the # of searches that these 6 billion pages would rank for don't warrant the spidering of them.

I see what you mean now ;) Oh one other suggestion....when ATW reached 3 billion Google was not stagnating ;)

[vitaplease]

According to a study released in October 2000, the directly accessible "surface web" consists of about 2.5 billion pages, while the "deep web" (dynamically generated web pages) consists of about 550 billion pages, 95% of which are publicly accessible [LVDSS00]

from: [www10.org...]

Although I doubt the 550 billion number, Page&Brin got some dynamics to do..;)

[markus007]

How much of the web google has indexed compared to places surfers visit? I bet its something like 99.9%

[takagi]

Sergey got only 5 month left to get is goal! Hope it will have it.

For '03, Brin hopes to expand to catalog the Web's entire 10 billion pages. "I don't know if it will happen, but we hope to have the whole Web crawled."

(USA TODAY [usatoday.com] on December 17, 2002)

On the page www.google.com/3.html [google.com] Google states: New! Search 3 billion documents using Google.

My guess is they won't update the number of 3.03G reached on November 6 [webmasterworld.com] until they are over 4G. At that moment you will be able to read the news at www.google.com/4.html [google.com].