Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- Video sitemaps and CDNs
Mishaelo - 9:51 am on Sep 28, 2011 (gmt 0)Thread source:: http://www.webmasterworld.com/robots_txt/4367784.htm
but what if the sitemap index is on the root and the GZIP files are on the CDN subdomain?
Not sure what goes on the root robots.txt and on the subdomain robots.txt
Brought to you by WebmasterWorld: http://www.webmasterworld.com