Limit on page count?

google crawl behaviour

[scottj]

My site has 550,000 pages.
Google started indexing 3.5 days ago
and continued to index until about
midnight tonight. They had 9 bots on
the site crawl1.googlebot.com, crawl2, etc...

But they seem to have stopped crawling.
Is there a page limit of about 75K pages?
Does anyone know what the likely reason is?

The site is brand-new.

Thanks for any guidance regarding what
happened / what to expect google to
do next.

PS: The site contains academic science article
abstracts and so forth. All very rich data.

[vitaplease]

hi scottj,

thats a lot of pages to get indexed..

The main reason they are not all crawled/indexed:
6000 sites like yours and the 3 billion Google index is full.

I think a lot of how many pages are index is Pagerank related.
The higher the better. But also the more external deep links into your site the better.

[webmasterworld.com...]
and
[webmasterworld.com...]

[BigDave]

For a first time crawl 75,000 is pretty amazing! First crawl I had 5 pages, then ~50 and finally on the third month it hit the whole 1800 pages.

You must have some rather nice links for a new site.