Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Will URLs blocked in robots.txt remove currently indexed pages?


limitup - 6:14 am on Sep 2, 2009 (gmt 0)


Thanks for the replies. I've read conflicting advice Blan - many say that blocking the URLs in robots.txt WILL also get the already indexed pages removed.

The problem with either of your solutions above is that it would be an extremely labor intensive process as we would have to do that manually for over 500+ URLs. Surely there's an easier way ...


Thread source:: http://www.webmasterworld.com/robots_txt/3981036.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com