Forum Moderators: open

Message Too Old, No Replies

Is there a limit to the number of pages google will index?

Google Single-Site Cardinality

         

scottj

1:53 am on May 22, 2003 (gmt 0)

10+ Year Member



Hi,
How many pages is Google willing to index?
I am in a situation where Google spidered
through 75K pages two months ago but did not add
my site to the index last month.
I have 550K pages interlinked over 4
DNS names. Does google have an upper limit
on total-pages that they refuse to exceed
(and if you exceed it you are dropped?)

The site is a Rich-content academic
physics content site that has excellent
value to a large community of University
proffessors. It's not about diet-pills
or selling televisions (although those
things are very happy products) ... I just
mean that this is unique and deep value
content to a signifigant community so
rule-out the marketing-only aspects, this
is good stuff for a particular audience.

My company is a ".org" not for profit
service oriented company that has kept
it's proprietary content behind access-
control for many years and now wishes
to share a good deal of it for free
under search-engine-available circumstances...
So we are late to the game and I am on
the hook to learn this stuff.

Any thought(s) or information appreciated.

This site is great, I've learned a lot,
I planned out all my meta tags and other
aspects of my site based on careful reading
of all the posts to this site.

=Scott

vitaplease

4:22 am on May 22, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



Hi scottj,

550K pages may be a lot for immediate indexing...

From what I could gather, high Pagerank and many deep links should help most.

About 6.000 of your type of sites would already fill the complete Google index if my arithmetic is correct.

check this thread: [webmasterworld.com...]

rfgdxm1

3:10 am on May 22, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



How high is this site's PR? Google seems more inclined to go deep the higher the PR. From the way you describe this site, I should think it has some high PR .edu links.

Powdork

4:18 am on May 22, 2003 (gmt 0)

WebmasterWorld Senior Member 10+ Year Member



I did a search for the domain I suspect you are referring to, without the www. It reutrned your domain first and when I clicked on more results from this domain there were 23,600. Still shows no backlinks. I suspect you will be in more officially soon, or maybe it won't be soon. You know, more than days, less than months.

cYbErDaRk

2:10 pm on May 22, 2003 (gmt 0)

10+ Year Member



Hi folks

A few months ago I posted a message regarding my website had lost up to 25000 pages on the index. Most of them were from the forums section.

So, thinking that it was that, I added the header for Google no to index these pages... and everything started to work ok.

I also realized that Google does not index pages that include encoded text (as &tit=Hello%20Folks). I've now removed this stupid part of the URLs, and left Google to index these pages... and I'd started.

Now, the question. My site currently has more or less 250000 posted messages, so, imagine, a few thousand threads. Is there a limit when Google says "hey, too much URLs for you site"?

Regards, and sorry for my English.