Welcome to WebmasterWorld Guest from 23.22.200.6

Forum Moderators: Robert Charlton & aakk9999 & andy langton & goodroi

Message Too Old, No Replies

Should I create a sitemap for urls I want to have de-indexed?

     
12:56 pm on Aug 30, 2012 (gmt 0)

Junior Member

joined:Feb 19, 2012
posts: 129
votes: 0


Just made some more changes to remove another 80,000 or so urls from our site. I've updated my sitemaps to not include these urls, but now I'm wondering if I should maybe leave them in a sitemap just to ensure Google crawls and removes them. Since I'm concerned these urls have triggered Panda, I want them out of the index as soon as possible.

Some of these urls have noindex,follow on them. Some of them have canonical tags. Either way, they are on the way out.

I was thinking maybe one separate sitemap with all the urls I want gone might not be a bad idea. Or do you think this would send some bad signals to Google.
1:50 pm on Aug 30, 2012 (gmt 0)

Senior Member

WebmasterWorld Senior Member tedster is a WebmasterWorld Top Contributor of All Time 10+ Year Member

joined:May 26, 2000
posts:37301
votes: 0


Last year several people were recommending this approach and reporting "success" from their point of view.

However several Google sources have made it clear that Google doesn't want that. The Sitemap is supposed to be only those URLs that you do want to see indexed. I'd say there should be no concern about Google "losing" URLs - especially URLs that have been crawled recently. Google doesn't seem to forget a URL ever! So I've always gone with their direction and the results have been fine.
2:23 pm on Aug 30, 2012 (gmt 0)

Senior Member

WebmasterWorld Senior Member 5+ Year Member

joined:July 26, 2006
posts: 1619
votes: 0


Very interesting, I had not thought of doing that, but I guess if Google doesn't want us to do that then maybe we shouldn't.

Google still crawls or attempts to crawl pages that have been gone for years.... literally years.
8:53 pm on Aug 30, 2012 (gmt 0)

Junior Member

joined:Feb 19, 2012
posts: 129
votes: 0


Thanks tedster, I'll just leave it for them to figure out then :) They crawl the site pretty hard anyway, so the majority will probably be removed pretty quickly.
 

Join The Conversation

Moderators and Top Contributors

Hot Threads This Week

Featured Threads

Free SEO Tools

Hire Expert Members