Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Google Index robots.txt
Elsmarc - 12:32 pm on Aug 25, 2012 (gmt 0)Thread source:: http://www.webmasterworld.com/robots_txt/4487907.htm
What will happen if, for example, I have a directory which is excluded in robots.txt but files in that directory and sub-directories are in the sitemap?
Brought to you by WebmasterWorld: http://www.webmasterworld.com