gpmgroup - 12:05 am on Jan 29, 2007 (gmt 0)

Just to bring this thread back on topic and to clarify my concerns which are based on observations of hundreds of sites I run. Old sites (pre September ish 2006 have all pages indexed no problem and they are still all included) New sites from the end of 2006 onwards only get the homepage indexed with no further crawling. To include further pages a manual submit is required which is tedious but works.

Just launched a small new site and non index pages are showing up in the index in under 14 days. (No manual submitting etc was done)

Google was the quickest to index it - under 3 days, MSN under 14 days and Yahoo have yet to index it.