Welcome to WebmasterWorld Guest from

Forum Moderators: Robert Charlton & goodroi

Message Too Old, No Replies

Google link spidering and indexing - how many are TOO many?

6:15 pm on Apr 15, 2010 (gmt 0)

Junior Member

10+ Year Member

joined:July 3, 2003
votes: 1

I have a huge index page that has probably up to 1000 links on it (most are internal - to product categories and stuff)

I was wondering about the google spidering. Is there a "cut off" link number vaue after which google will no longer spider/index/include them?

The reason i ask is because out of those 1000 unique pages from the site, linked from the index page, only about 400 are indexed in google (link:website.com)

I though that google would eventually update their database and include all the pages when doing link:website.com search, but after about 3 months it's still showing only 400 pages indexed.

So the big question: does google has a quota of the number of links it spiders on a particular page?
11:10 pm on Apr 15, 2010 (gmt 0)

Senior Member

WebmasterWorld Senior Member tedster is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:May 26, 2000
votes: 0

There's no hard an fast cut-off today. A few years back it was around 100 links. I'd say if the target urls for your 1,000 links aren't even getting indexed, then you do have too many links on that page, and you also need some other click path navigation to those deep pages.

Also realize that backlinks may play into the picture when you're trying to get more of a site indexed. Plus, this is not a good time to depend on the site: operator for the number of indexed pages. It seems to be unusually inaccurate right now.