Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Google "URL exclusion" not following our robots.txt!


joeduck - 2:36 am on Sep 21, 2005 (gmt 0)


The problem is that using URL exclusion it should take only a few days, then Google follows the new robots.txt instructions, you get a removal "complete" message, and the pages are gone. I've used it many times for subdirectories, but never on subdomain as here.

I got the "complete" message and they are not gone which means the robots.txt is not getting followed correctly.


Thread source:: http://www.webmasterworld.com/robots_txt/740.htm
Brought to you by WebmasterWorld: http://www.webmasterworld.com