Page is a not externally linkable
dberube - 1:13 am on Sep 11, 2007 (gmt 0)
My real question was, will the speed/rate at which Google is crawling the site now stay consistent, or pickup once it realized that there are a lot more pages to crawl? The content is all unique, as it pertains to my site, it's a Yellow Pages type of site, with extra content such as City news, classifieds, and weather. I hope that will be enough extra content for Google to not think it's a dupe of another site. I've also compared similar and the % of the same is not that great. Obviously the business name, address, etc is the same, but that's about it. You bring up an interesting point with only showing Google the most important pages right now, what advantage does that give me? Wouldn't I want to expose as much as possible to Google?
I know that it'll never be fully indexed, I posed the question wrong I guess. I actually did the same thing, site:amazon.com to see how many were indexed.