Welcome to WebmasterWorld Guest from 54.196.212.62

Message Too Old, No Replies

Google link spidering and indexing - how many are TOO many?

     

Jessica

6:15 pm on Apr 15, 2010 (gmt 0)

10+ Year Member



I have a huge index page that has probably up to 1000 links on it (most are internal - to product categories and stuff)

I was wondering about the google spidering. Is there a "cut off" link number vaue after which google will no longer spider/index/include them?

The reason i ask is because out of those 1000 unique pages from the site, linked from the index page, only about 400 are indexed in google (link:website.com)

I though that google would eventually update their database and include all the pages when doing link:website.com search, but after about 3 months it's still showing only 400 pages indexed.

So the big question: does google has a quota of the number of links it spiders on a particular page?

tedster

11:10 pm on Apr 15, 2010 (gmt 0)

WebmasterWorld Senior Member tedster is a WebmasterWorld Top Contributor of All Time 10+ Year Member



There's no hard an fast cut-off today. A few years back it was around 100 links. I'd say if the target urls for your 1,000 links aren't even getting indexed, then you do have too many links on that page, and you also need some other click path navigation to those deep pages.

Also realize that backlinks may play into the picture when you're trying to get more of a site indexed. Plus, this is not a good time to depend on the site: operator for the number of indexed pages. It seems to be unusually inaccurate right now.
 

Featured Threads

Hot Threads This Week

Hot Threads This Month