Welcome to WebmasterWorld Guest from 54.145.235.72

Should I create a sitemap for urls I want to have de-indexed?

   
12:56 pm on Aug 30, 2012 (gmt 0)



Just made some more changes to remove another 80,000 or so urls from our site. I've updated my sitemaps to not include these urls, but now I'm wondering if I should maybe leave them in a sitemap just to ensure Google crawls and removes them. Since I'm concerned these urls have triggered Panda, I want them out of the index as soon as possible.

Some of these urls have noindex,follow on them. Some of them have canonical tags. Either way, they are on the way out.

I was thinking maybe one separate sitemap with all the urls I want gone might not be a bad idea. Or do you think this would send some bad signals to Google.
1:50 pm on Aug 30, 2012 (gmt 0)

WebmasterWorld Senior Member tedster is a WebmasterWorld Top Contributor of All Time 10+ Year Member



Last year several people were recommending this approach and reporting "success" from their point of view.

However several Google sources have made it clear that Google doesn't want that. The Sitemap is supposed to be only those URLs that you do want to see indexed. I'd say there should be no concern about Google "losing" URLs - especially URLs that have been crawled recently. Google doesn't seem to forget a URL ever! So I've always gone with their direction and the results have been fine.
2:23 pm on Aug 30, 2012 (gmt 0)

WebmasterWorld Senior Member 5+ Year Member



Very interesting, I had not thought of doing that, but I guess if Google doesn't want us to do that then maybe we shouldn't.

Google still crawls or attempts to crawl pages that have been gone for years.... literally years.
8:53 pm on Aug 30, 2012 (gmt 0)



Thanks tedster, I'll just leave it for them to figure out then :) They crawl the site pretty hard anyway, so the majority will probably be removed pretty quickly.
 

Featured Threads

My Threads

Hot Threads This Week

Hot Threads This Month