Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Google does not honor robots.txt
phranque - 10:17 am on Sep 12, 2013 (gmt 0)Thread source:: http://www.webmasterworld.com/robots_txt/4600575.htm
does your robots.txt have a separate set of exclusion directives for User-agent: Googlebot or similar specification?
Brought to you by WebmasterWorld: http://www.webmasterworld.com