Page is a not externally linkable
-- Google SEO News and Discussion
---- Pages are indexed even after blocking in robots.txt
lucy24 - 9:15 pm on Aug 31, 2012 (gmt 0)Thread source:: http://www.webmasterworld.com/google/4490125.htm
|If the URL is in your sitemap, the page will be crawled. |
Even if it is in a roboted-out directory?
Brought to you by WebmasterWorld: http://www.webmasterworld.com