Page is a not externally linkable
- Google
-- Google SEO News and Discussion
---- Best method of getting pages out of Google's index


klark0 - 1:04 am on Aug 1, 2012 (gmt 0)


maverick, you probably shouldn't use robots.txt plus noindex,follow.

blocking via robots.txt doesn't prevent urls from being indexed ..it also doesn't remove existing urls from the index. If you have add noindex,follow to the pages, then google will never know about it since they can't read the page. They'll only know about the URL.

At least that's what I understand and have experienced.

Just do the removal inside WMT, and ensure noindex,follow on all pages you want out of the index. There's really no need for anything in your robots.txt, besides an Allow all and a link to your sitemap index.


Thread source:: http://www.webmasterworld.com/google/4480536.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com