Is there a limit to the number of pages Google indexes?

[darkeye]

Hola,

a question: I'm working on a big homepage for a city. The homepage has about 10.000 sites only with php- and html-filenames. We want, that google spiders all these sites.
But are 10.000 sites too much to get into google's index?

Is there a limit of spidered sites?

Thanx!
Darkeye

[bhartzer]

As far as I know, there isn't a limit. I have a site that has over 100,000 spidered pages, but that's only one site. However, when you get into 10,000 separate sites, it can get tricky to make sure that the engines don't find duplicate content.

[benihana]

if the page is simply 10000 links and no 'real' content google may think you are a link farm which could cause you problems.

also the google guidelines recommend that you dont have more than 100 links on any one page (ive been punished for this in the past).

finally the googlebot stops reading a page at a certain filesize (101kb i think) - I would have thought that 10000 links may take your page over this limit.

ben

[ciml]

I agree with benihana, 10,000 links on one page would do no good.

If you had four levels in a pyramid, the first three each having 21 or 22 links, then I don't see why Google can't crawl the site if you have plenty of PageRank.

[google.com...]