homepage Welcome to WebmasterWorld Guest from
register, free tools, login, search, pro membership, help, library, announcements, recent posts, open posts,
Become a Pro Member

Home / Forums Index / Google / Google SEO News and Discussion
Forum Library, Charter, Moderators: Robert Charlton & aakk9999 & brotherhood of lan & goodroi

Google SEO News and Discussion Forum

Is it OK to use sitemaps to point to NOINDEX tagged pages?
I still need these to be crawled for now

5+ Year Member

Msg#: 3168378 posted 10:48 am on Nov 26, 2006 (gmt 0)

I am suffering from duplicate content penalties across my network of sites, even though running the same articles on multiple sites (for different audiences) is a quite morally valid procedure, editorially.

However, Google has taken over from the reader as king now, sadly. To ovecome the penalties while leaving the pages in place, I have opted for a strategy of marking duplicates with NOINDEX meta tags, and these are being gradually picked up by Googlebot and removed from the index, which should eventually give me a duplicate-free network of sites in Google's eyes.

I am also in the process of setting up sitemaps for each site. The question now is - option 1 - do I include in the sitemaps the pages marked with NOINDEX meta tags (even though that's a rather strange thing to do), because I still need Google to crawl these pages to realise they've been NOINDEXed? Or - option 2 - do I omit the NOINDEXed pages, giving a "true" representation of my slimmed-down sites, and hope that the NOINDEXed pages get crawled separately regardless, through more conventional spidering? There are still good links to these NOINDEXed pages on the sites.



10+ Year Member

Msg#: 3168378 posted 3:59 am on Nov 29, 2006 (gmt 0)

I have wondered about this as well. BTW does anyone know of some commercial software that can be used to detect duplicate content?


WebmasterWorld Senior Member 5+ Year Member

Msg#: 3168378 posted 6:33 pm on Nov 29, 2006 (gmt 0)

I also wondered about this issue.

I decided to use the G removal tool on the NOINDEX pages, which I hoped addressed the issue of bringing these to Google's attention. I then removed them from my G sitemaps -- I list only *valid and good* urls there-- and resubmitted the sitemaps.

After 4 days I'm seeing a slight improvement, but nothing yet to prove I've got the answer.

Global Options:
 top home search open messages active posts  

Home / Forums Index / Google / Google SEO News and Discussion
rss feed

All trademarks and copyrights held by respective owners. Member comments are owned by the poster.
Home ¦ Free Tools ¦ Terms of Service ¦ Privacy Policy ¦ Report Problem ¦ About ¦ Library ¦ Newsletter
WebmasterWorld is a Developer Shed Community owned by Jim Boykin.
© Webmaster World 1996-2014 all rights reserved