---- How long for Google to spider 29.5 million pages?
arubicus - 6:54 am on Sep 14, 2007 (gmt 0)
29.5 million pages? Wow. It must have taken forever for them to write that many pages.
I guess the same can be said for Google, Google News, Google Images, Google Search Results, Google Books, Cached Pages in Google Search, etc. (Just poking fun - Nobody get their Google Underoos in a bunch please).
It all comes down to statistical probability: If you're going to dump 29.5 million pages onto the Web, the burden of proof will be on you to convince the search engines that your content is worth indexing, bacause the odds that most of your pages contain useful and unique content aren't very high.