Page is a not externally linkable
- Search Engines
-- Sitemaps, Meta Data, and robots.txt
---- How can I block these kinds of urls?
robzilla - 12:12 pm on Aug 1, 2011 (gmt 0)Thread source:: http://www.webmasterworld.com/robots_txt/4346151.htm
I would recommend implementing the canonical tag [googlewebmastercentral.blogspot.com], the effect being similar to a 301 redirect, over the blocking of pages via robots.txt.
Brought to you by WebmasterWorld: http://www.webmasterworld.com