Jessica - 6:15 pm on Apr 15, 2010 (gmt 0)
I have a huge index page that has probably up to 1000 links on it (most are internal - to product categories and stuff)
I was wondering about the google spidering. Is there a "cut off" link number vaue after which google will no longer spider/index/include them?
The reason i ask is because out of those 1000 unique pages from the site, linked from the index page, only about 400 are indexed in google (link:website.com)
I though that google would eventually update their database and include all the pages when doing link:website.com search, but after about 3 months it's still showing only 400 pages indexed.
So the big question: does google has a quota of the number of links it spiders on a particular page?