Hi All,
I have a forum site where I have put
<META NAME="ROBOTS" CONTENT="NOINDEX, FOLLOW">
on all post listings (and there are many hundreds of pages of them). The thinking was that since they don't really contain anything other than the lists of actual content pages and links to the same, they are of lesser quality and therefore should be excluded from G* index.
I am now of an opinion that I must have been not feeling well when I dreamed this scheme up. What I think has happened is I disrupted the entire internal PR distribution because I have eliminated an entire level of links: most of the listings are only 1 level deep from the homepage and most of the content is two levels deep - through that listings level which I have no-indexed. Some content pages are linked from elsewhere (internally and ex-) but most have no other links but from the no-indexed listings.
Anyways, I am removing the noindex meta tags from the listings pages and the question then becomes: will these pages get revisited and re-indexed or they'll stay no-indexed forever because they would not re-process them because they already know from the past that they should not be indexed?
I hope I'm making some sense here (both in terms of no-index effect on internal PR distribution and in my concern for permanency of no-index tag) and would love to hear from other webmasters that might have gone through this change in the past - how quickly (if ever) can pages regain "INDEX" status after having been NOINDEX'ed for awhile?
Thanks!