Welcome to WebmasterWorld Guest from 54.198.15.59

Forum Moderators: Robert Charlton & aakk9999 & andy langton & goodroi

Message Too Old, No Replies

How long for Google to remove NOINDEX pages from its index?

     
11:55 am on Aug 30, 2013 (gmt 0)

New User

joined:Aug 27, 2013
posts:12
votes: 0


Hi,

There are around 300 pages submitted in sitemap and indexed by google as well. Later came to know that these pages not necessary to be indexed, so I marked it as NOINDEX and removed from sitemap as well.
How long usually does it take to remove pages from google index?
1:46 pm on Aug 30, 2013 (gmt 0)

Senior Member from US 

WebmasterWorld Senior Member 5+ Year Member

joined:Nov 11, 2007
posts:769
votes: 1


Depends on how often your site is deep crawled. Typically not long for a site with lots of links.

You can speed it up by going into Google Webmaster Tools and using the URL removal tool to request that they be removed. Then the <meta name="robots" content="noindex"> element should prevent them from being re-indexed.
.

[edited by: Robert_Charlton at 5:32 pm (utc) on Sep 1, 2013]
[edit reason] fixed typo at poster's request [/edit]

3:14 pm on Aug 31, 2013 (gmt 0)

Preferred Member

5+ Year Member

joined:Mar 22, 2011
posts:399
votes: 0


I would recommend using Google Webmaster Tools as well.

I just went through ranking hell by not using that first. Google Webmaster Tools definitely speeds the noindex big time.
12:58 am on Sept 1, 2013 (gmt 0)

Senior Member

WebmasterWorld Senior Member planet13 is a WebmasterWorld Top Contributor of All Time 5+ Year Member Top Contributors Of The Month

joined:June 16, 2010
posts: 3813
votes: 29


You can speed it up by going into Google Webmaster Tools and using the URL removal tool to request that they be removed.


I thought those pages would have to either send a 404 / 410 header or be blocked by robots.txt to have the URL removal tool work, no?
6:34 am on Sept 1, 2013 (gmt 0)

New User

joined:Aug 27, 2013
posts:12
votes: 0


Thanks,
It has been 4 days I marked it as NOINDEX, google does crawl daily however pages are still there in google index.
I will update you all
7:51 am on Sept 1, 2013 (gmt 0)

Moderator This Forum from US 

WebmasterWorld Administrator robert_charlton is a WebmasterWorld Top Contributor of All Time 10+ Year Member Top Contributors Of The Month

joined:Nov 11, 2000
posts:11528
votes: 227


I thought those pages would have to either send a 404 / 410 header or be blocked by robots.txt to have the URL removal tool work, no?

No, not as I understand it.

The removal tool only removes a url for 90 days. If the page no longer exists after you remove it with the removal tool, you need to make sure that a 404/410 is sent before the 90 days is up to keep Google from re-including the url. I don't believe a 404 or 410 is necessary for the tool to work in the first place, though.

And, if the page will still exist after the 90 days, you can use robots.txt to keep Google from spidering the page. robots.txt, though, will not necessarily keep all references to the page out of the index.

You can use meta robots noindex (without robots.txt) to keep references to an existing page out of the visible index once the 90 days is up. Again, noindex should not be necessary for the tool to work.


And here's an excellent discussion on the distinction between indexing and crawling... not necessarily relevant to a discussion about the removal tool, but since I've mention robots.txt and noindex in the same discussion, someone will surely leap in to clarify, and we'll be doomed to repeat this discussion again ;) ...

Pages are indexed even after blocking in robots.txt
http://www.webmasterworld.com/google/4490125.htm [webmasterworld.com]
12:25 pm on Sept 1, 2013 (gmt 0)

Moderator This Forum from GB 

WebmasterWorld Administrator 5+ Year Member Top Contributors Of The Month

joined:Apr 30, 2008
posts:2599
votes: 179


It has been 4 days I marked it as NOINDEX, google does crawl daily however pages are still there in google index.

This is too short time to check. You must give Google some time to update its index.
1:12 pm on Sept 1, 2013 (gmt 0)

Senior Member from LK 

WebmasterWorld Senior Member 10+ Year Member Top Contributors Of The Month

joined:Nov 16, 2005
posts: 2509
votes: 31


Is it a good idea to use the URL removal tool if you want the page to be noindex follow rather than noindex nofollow?

Also, there can be a delay of weeks between the crawl and the changes being reflected in the SERPS. I have added noindex tags to some pages and changed the text on others and it can take weeks for them to show, on a site that is fully crawled every two days or so.
1:34 pm on Sept 1, 2013 (gmt 0)

Preferred Member

5+ Year Member

joined:Mar 22, 2011
posts:399
votes: 0


I took me about 6 weeks for a directory of 1000s of pages on a pretty popular site, last I checked.

Single pages take about 2 weeks.
11:00 pm on Sept 1, 2013 (gmt 0)

Full Member

10+ Year Member

joined:May 3, 2003
posts:269
votes: 22


Using a NoIndex meta tag, and the webmaster tools URL removal tool gets rid of them in less than 24 hours for me.

But the URL removal tool seems to be limited to a few hundred URLs per day.

You do need to take the URLs out one at a time though - I tried taking whole directories out by using robots.txt and the URL removal tool - and the removals expired after three months, and the pages came back (albeit with no description due to robots.txt).