Page is a not externally linkable
- Google
-- Google SEO News and Discussion
---- How long for Google to spider 29.5 million pages?


yandos - 1:58 pm on Sep 11, 2007 (gmt 0)


Good luck with indexing as i think you're gonna need it. I have similar yellow pages style sites and what worked a couple of years ago (getting million+ pages in the index in a few months) just doesn't happen any more. I had one site trying to list about the same amount of pages as yours and pointing PR5+ link after link it just wouldn't index it all.

Half of the issue is the amount of navigation levels you would need. either a very deep structure - index/state/county/city/businesstype/listing is 6 levels deep from homepage, or a broad structure - index/state/city/listing which would result in thousands of links per page.

The other half of the issue is googles clearing up of spam in the index over the past few years. You say that your pages are unique but i'm pretty sure i'd have the same type of information as you have, with the same company contact details, optimised for the company name etc. There are sites with exactly the same info as you which have been around a lot longer.

Think of it from googles angle, it sees a brand new site with say 60% similar content to other sites, 20% similar to other pages on your site (looking for info on <businesstype> in <cityname> etc) and the whole site has 29 million pages. Do you not think this is going to sound the alarm bell for googlebot?


Thread source:: http://www.webmasterworld.com/google/3446746.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com