Forum Moderators: open

Message Too Old, No Replies

What share of the www would google index?

How big is the invisible web?

         

vitaplease

6:30 pm on Mar 8, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Google has now well over 3 billion pages/documents in its index.

What part would they be missing as of now?

and how large is the web growing?

A very rough estimate of what Google is adding per update:

[webmasterworld.com...]

a check for the/and/a and multiply those results with 1.03 to the power of 10 (ten updates since then)
gives roughly the indexed amount as of now.

So the Google (english) index may be growing at approx. 3% per update?
(this last update 3.5% but thats mostly due to dynamic added pages?)

conor

3:02 am on Mar 9, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



>>What part would they be missing as of now?

Not much! ;)

born2drv

3:19 am on Mar 9, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



There's probably another 1/2 billion or so in various message boards like yahoo groups, etc....

Then there is all the dynamic content which is not indexed properly due to session ID's(I just modified my PhpBB message board so it could be properly indexed). There are also lots of shopping carts out there that are not spidered properly.

And there's a ton of other content pages which I think should be in Google such as Yahoo/MSN/ICQ profiles. It would be nice to search for a long lost buddy like "John Smith Long Island New York" and see his profile pop up so you could email or IM him.