homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

Google link spidering and indexing - how many are TOO many?

10+ Year Member

Msg#: 4116478 posted 6:15 pm on Apr 15, 2010 (gmt 0)

I have a huge index page that has probably up to 1000 links on it (most are internal - to product categories and stuff)

I was wondering about the google spidering. Is there a "cut off" link number vaue after which google will no longer spider/index/include them?

The reason i ask is because out of those 1000 unique pages from the site, linked from the index page, only about 400 are indexed in google (link:website.com)

I though that google would eventually update their database and include all the pages when doing link:website.com search, but after about 3 months it's still showing only 400 pages indexed.

So the big question: does google has a quota of the number of links it spiders on a particular page?



WebmasterWorld Senior Member tedster us a WebmasterWorld Top Contributor of All Time 10+ Year Member

Msg#: 4116478 posted 11:10 pm on Apr 15, 2010 (gmt 0)

There's no hard an fast cut-off today. A few years back it was around 100 links. I'd say if the target urls for your 1,000 links aren't even getting indexed, then you do have too many links on that page, and you also need some other click path navigation to those deep pages.

Also realize that backlinks may play into the picture when you're trying to get more of a site indexed. Plus, this is not a good time to depend on the site: operator for the number of indexed pages. It seems to be unusually inaccurate right now.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved